Nov 05 10:46:02 devstack cinder-volume[76054]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 10:46:02 devstack cinder-volume[76054]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 10:46:02 devstack cinder-volume[76054]: we strongly recommend against using it for new projects. Nov 05 10:46:02 devstack cinder-volume[76054]: If you are already using Eventlet, we recommend migrating to a different Nov 05 10:46:02 devstack cinder-volume[76054]: framework. For more detail see Nov 05 10:46:02 devstack cinder-volume[76054]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 10:46:02 devstack cinder-volume[76054]: import eventlet # noqa Nov 05 10:46:05 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:46:05 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:46:05 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:46:06 devstack cinder-volume[76054]: INFO dbcounter [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Registered counter for database cinder Nov 05 10:46:06 devstack cinder-volume[76054]: DEBUG oslo_db.sqlalchemy.engines [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:46:06 devstack cinder-volume[76054]: DEBUG dbcounter [-] [76054] Writer thread running {{(pid=76054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:46:06 devstack cinder-volume[76054]: INFO cinder.rpc [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 10:46:06 devstack cinder-volume[76054]: INFO cinder.rpc [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 10:46:06 devstack cinder-volume[76054]: DEBUG oslo_db.sqlalchemy.engines [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:46:06 devstack cinder-volume[76054]: INFO cinder.volume.manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Determined volume DB was empty at startup. Nov 05 10:46:06 devstack cinder-volume[76054]: DEBUG cinder.volume.manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76054) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 10:46:07 devstack cinder-volume[76054]: INFO cinder.volume.manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 10:46:07 devstack cinder-volume[76054]: WARNING stevedore.named [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 10:46:07 devstack cinder-volume[76054]: WARNING castellan.key_manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:46:07 devstack cinder-volume[76054]: WARNING cinder.keymgr.conf_key_mgr [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG cinder.volume.drivers.lvm [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76054) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_concurrency.processutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_concurrency.processutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] CMD "cinder-rtstool verify" returned: 0 in 0.433s {{(pid=76054) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_db.sqlalchemy.engines [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:46:07 devstack cinder-volume[76054]: INFO cinder.rpc [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 05 10:46:07 devstack cinder-volume[76054]: INFO cinder.rpc [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 05 10:46:07 devstack cinder-volume[76054]: WARNING stevedore.named [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 10:46:07 devstack cinder-volume[76054]: WARNING castellan.key_manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:46:07 devstack cinder-volume[76054]: INFO cinder.volume.manager [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_db.sqlalchemy.engines [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76054) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:46:07 devstack cinder-volume[76054]: INFO oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Starting 1 workers Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Started child 76259 {{(pid=76054) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 10:46:07 devstack cinder-volume[76259]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Full set of CONF: {{(pid=76054) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] ******************************************************************************** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Configuration options gathered from: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] ================================================================================ {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] allow_availability_zone_fallback = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] allow_compression_on_image_upload = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] allowed_direct_url_schemes = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] api_rate_limit = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] auth_strategy = keystone {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] az_cache_duration = 3600 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_availability_zone = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_host = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_stats_polling_interval = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backup_api_class = cinder.backup.api.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backup_name_template = backup-%s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backup_use_same_host = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backup_use_temp_snapshot = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] chap_password = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] chap_username = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_internal_tenant_project_id = c0716896349e4cde8d37c0d577c200f5 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_internal_tenant_user_id = 7b9297ae0ecc440cb4e4343efb9e25ed {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cloned_volume_same_az = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cluster = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] compression_format = gzip {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] compute_api_class = cinder.compute.nova.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] config_dir = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] config_source = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] control_exchange = openstack {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] debug = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] default_availability_zone = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] default_group_type = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] default_volume_type = lvmdriver-1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] disk_geometry = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_client_cert = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_client_cert_key = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_data_namespace = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_ssl_cert_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_ssl_cert_verify = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] driver_use_ssl = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] enable_force_upload = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] enable_new_services = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] enable_unsupported_driver = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76259]: INFO cinder.volume.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] enabled_backends = ['lvmdriver-1'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] enforce_multipath_for_image_xfer = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] filter_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_api_insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_api_ssl_compression = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_ca_certificates_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_catalog_info = image:glance:publicURL {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_num_retries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance_request_timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] goodness_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] graceful_shutdown_timeout = 5 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] group_api_class = cinder.group.api.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] host = devstack {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_compress_on_upload = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_conversion_address_space_limit = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_conversion_cpu_limit = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_conversion_disable = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_introspection_address_space_limit = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_introspection_cpu_limit = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_upload_use_cinder_backend = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_upload_use_internal_tenant = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_volume_cache_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_volume_cache_max_count = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] image_volume_cache_max_size_gb = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] init_host_max_objects_retrieval = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] instance_format = [instance: %(uuid)s] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iscsi_target_flags = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iscsi_write_cache = on {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iser_helper = tgtadm {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iser_ip_address = 192.168.122.167 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iser_port = 3260 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_color = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_config_append = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_dir = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_options = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_rotate_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_rotate_interval_type = days {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] log_rotation_type = none {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] max_age = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] max_logfile_count = 30 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] max_logfile_size_mb = 200 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] max_over_subscription_ratio = 20.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] message_reap_interval = 86400 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] message_ttl = 2592000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] migration_create_volume_timeout_secs = 300 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] monkey_patch = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] monkey_patch_modules = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] my_ip = 192.168.122.167 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] no_snapshot_gb_quota = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] num_iser_scan_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] num_shell_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] num_volume_device_scan_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] nvmeof_conn_info_version = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] nvmet_ns_id = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] nvmet_port_id = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_max_limit = 1000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_ext_list = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_listen = 0.0.0.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_listen_port = 8776 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_use_ssl = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] osapi_volume_workers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] per_volume_size_limit = -1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] periodic_fuzzy_delay = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] periodic_interval = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] project_id_regex = [0-9a-f\-]+ {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] public_endpoint = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] publish_errors = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_backup_gigabytes = 1000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_backups = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.046s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_gigabytes = 1000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_groups = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_snapshots = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] quota_volumes = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] rate_limit_burst = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] rate_limit_except_level = CRITICAL {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] rate_limit_interval = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] reinit_driver_count = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] replication_device = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] report_discard_supported = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] report_interval = 120 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] reservation_clean_interval = 86400 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] reservation_expire = 86400 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] reserved_image_namespaces = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] reserved_percentage = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] rpc_response_timeout = 120 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] run_external_periodic_tasks = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] scst_target_driver = iscsi {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] scst_target_iqn_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_down_time = 720 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] shell_completion = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] snapshot_name_template = snapshot-%s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] snapshot_same_host = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] split_loggers = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] state_path = /opt/stack/data/cinder {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] storage_availability_zone = nova {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] storage_protocol = iSCSI {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] syslog_log_facility = LOG_USER {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_helper = lioadm {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_ip_address = 192.168.122.167 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_port = 3260 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_protocol = iscsi {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] target_secondary_ip_addresses = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] trace_flags = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] transfer_api_class = cinder.transfer.api.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] transport_url = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] until_refresh = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_chap_auth = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_default_quota_class = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_journal = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_json = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_multipath_for_image_xfer = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_stderr = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] use_syslog = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] verify_glance_signatures = enabled {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_api_class = cinder.volume.api.API {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_backend_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_clear = zero {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_clear_ionice = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_clear_size = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_copy_bps_limit = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_dd_blocksize = 1M {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_name_template = volume-%s {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_service_inithost_offload = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volume_usage_audit_period = month {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] zoning_mode = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_concurrency.disable_process_locking = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.auth_section = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.auth_type = password {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.auth_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.cache = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.delay_auth_decision = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.http_connect_timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.include_service_catalog = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.interface = public {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_password = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack sudo[76263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack sudo[76263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcache_username = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.region_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.service_token_roles_required = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.service_type = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.token_cache_time = 300 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.backend = dogpile.cache.null {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.backend_argument = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.backend_expiration_time = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.config_prefix = cache.oslo {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.debug_cache_backend = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.enable_retry_client = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.enable_socket_keepalive = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.expiration_time = 600 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.hashclient_retry_attempts = 2 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_dead_retry = 300 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_pool_maxsize = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_sasl_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.password = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.proxies = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.redis_db = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.redis_sentinel_service_name = mymaster {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.redis_server = localhost:6379 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.retry_attempts = 2 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.retry_delay = 0.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.socket_keepalive_count = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.socket_keepalive_idle = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.socket_keepalive_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.socket_timeout = 1.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.tls_allowed_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.tls_cafile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.tls_certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.tls_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.tls_keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cache.username = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] coordination.backend_url = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.asyncio_connection = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.asyncio_slave_connection = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.backend = sqlalchemy {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.connection = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.connection_debug = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.connection_parameters = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.connection_recycle_time = 3600 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.connection_trace = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.db_inc_retry_interval = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.db_max_retries = 20 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.db_max_retry_interval = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.db_retry_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.max_overflow = 50 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.max_pool_size = 5 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.max_retries = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.mysql_wsrep_sync_wait = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.pool_timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.retry_interval = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.slave_connection = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.sqlite_synchronous = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.synchronous_reader = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] database.use_db_reconnect = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_tracing.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.connection_string = messaging:// {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.es_doc_type = notification {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.es_scroll_size = 10000 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.es_scroll_time = 2m {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.filter_error_trace = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.hmac_keys = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.sentinel_service_name = mymaster {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.socket_timeout = 0.1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.trace_requests = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler.trace_sqlalchemy = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler_jaeger.process_tags = {} {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler_jaeger.service_name_prefix = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] profiler_otlp.service_name_prefix = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.enforce_new_defaults = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.policy_default_rule = default {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.policy_file = policy.yaml {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_policy.remote_timeout = 60.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.group = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.helper_command = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] privsep_osbrick.user = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.group = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.helper_command = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] cinder_sys_admin.user = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.auth_section = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.auth_type = password {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.cafile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.collect_timing = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.send_service_user_token = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.split_loggers = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.tls_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] service_user.tls_min_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.auth_section = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.auth_type = password {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.collect_timing = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.region_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.split_loggers = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.tls_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] glance.tls_min_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.backend_availability_zone = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.chap_password = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.chap_username = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.disk_geometry = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_client_cert = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_client_cert_key = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_data_namespace = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.driver_use_ssl = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.enable_unsupported_driver = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.extra_capabilities = {} {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.filter_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.goodness_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iscsi_target_flags = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iscsi_write_cache = on {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iser_helper = tgtadm {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iser_port = 3260 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.lvm_mirrors = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.lvm_share_target = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.lvm_type = auto {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.num_shell_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.nvmet_port_id = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:07 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.replication_device = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.report_discard_supported = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.reserved_percentage = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.scst_target_driver = iscsi {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.scst_target_iqn_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.storage_protocol = iSCSI {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_helper = tgtadm {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_port = 3260 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_protocol = iscsi {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.trace_flags = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.unique_fqdn_network = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.use_chap_auth = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_backend_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_clear = zero {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_clear_ionice = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_clear_size = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volume_group = cinder-volumes {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_reports.file_event_handler = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_reports.log_dir = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.backend_availability_zone = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.backend_host = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.chap_password = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.chap_username = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.chiscsi_conf = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.disk_geometry = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_client_cert = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_data_namespace = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.driver_use_ssl = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.extra_capabilities = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.filter_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.goodness_function = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iser_helper = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iser_ip_address = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iser_port = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.iser_target_prefix = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.lvm_conf_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.lvm_mirrors = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.lvm_share_target = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.lvm_type = auto {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.num_shell_tries = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.nvmet_port_id = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.replication_device = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.report_discard_supported = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.reserved_percentage = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.scst_target_driver = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.storage_protocol = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_helper = lioadm {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_ip_address = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_port = 3260 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_protocol = iscsi {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.trace_flags = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.use_chap_auth = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_clear = zero {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_clear_size = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] lvmdriver-1.volumes_dir = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.ssl_version = {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_notifications.driver = [] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_notifications.retry = -1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] oslo_messaging_notifications.transport_url = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] key_manager.fixed_key = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.barbican_api_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.barbican_endpoint = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.barbican_endpoint_type = public {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.barbican_region_name = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.cafile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.collect_timing = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.number_of_retries = 60 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.retry_delay = 1 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.send_service_user_token = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.split_loggers = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.tls_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.tls_min_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.verify_ssl = True {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican.verify_ssl_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.auth_section = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.auth_type = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.cafile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.certfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.collect_timing = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.insecure = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.keyfile = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.split_loggers = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.timeout = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.tls_ciphers = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] barbican_service_user.tls_min_version = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.approle_role_id = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.approle_secret_id = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.auth_method = approle {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.auth_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.kv_mountpoint = secret {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.kv_path = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.kv_version = 2 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.namespace = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.root_token_id = **** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.ssl_ca_crt_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.timeout = 60.0 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.token_file = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.token_role = None {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.use_ssl = False {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:46:08 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] ******************************************************************************** {{(pid=76054) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 10:46:08 devstack sudo[76263]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.403s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:08 devstack sudo[76274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:08 devstack sudo[76274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:08 devstack sudo[76274]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.294s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 10:46:08 devstack cinder-volume[76259]: INFO cinder.brick.local_dev.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:08 devstack sudo[76434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:08 devstack sudo[76434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:08 devstack sudo[76434]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.327s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG cinder.brick.local_dev.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76259) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 05 10:46:08 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:08 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:08 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:09 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.572s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:09 devstack sudo[76675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:09 devstack sudo[76675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:09 devstack sudo[76675]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.297s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:09 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:09 devstack sudo[76776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 05 10:46:09 devstack sudo[76776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:10 devstack sudo[76776]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.354s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:10 devstack sudo[76879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:10 devstack sudo[76879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:10 devstack sudo[76879]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:10 devstack sudo[76882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:10 devstack sudo[76882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:10 devstack sudo[76882]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:10 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:10 devstack sudo[76967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:10 devstack sudo[76967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:11 devstack sudo[76967]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:11 devstack sudo[76970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:11 devstack sudo[76970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:11 devstack sudo[76970]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.331s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:11 devstack sudo[77060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:11 devstack sudo[77060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:11 devstack sudo[77060]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.305s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:11 devstack cinder-volume[76259]: INFO cinder.volume.drivers.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:11 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:11 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:11 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:12 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:12 devstack sudo[77073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:12 devstack sudo[77073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:12 devstack sudo[77073]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:12 devstack sudo[77076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:12 devstack sudo[77076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:12 devstack sudo[77076]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:12 devstack sudo[77079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:12 devstack sudo[77079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:12 devstack sudo[77079]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.302s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:12 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:12 devstack sudo[77082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:12 devstack sudo[77082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:13 devstack sudo[77082]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.266s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:13 devstack cinder-volume[76259]: INFO cinder.volume.driver [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG cinder.volume.driver [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76259) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_db.sqlalchemy.engines [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76259) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writer thread running {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG cinder.db.api [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Building query based on filter {{(pid=76259) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG cinder.image.image_utils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76259) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 10:46:13 devstack cinder-volume[76259]: INFO cinder.keymgr.migration [None req-4509b741-c02a-45eb-921f-8f201ee9ca54 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:13 devstack sudo[77085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:13 devstack sudo[77085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:13 devstack sudo[77085]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:13 devstack sudo[77090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:13 devstack sudo[77090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:13 devstack sudo[77090]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:13 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:13 devstack sudo[77093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:13 devstack sudo[77093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:14 devstack sudo[77093]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.283s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:14 devstack sudo[77096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:14 devstack sudo[77096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:14 devstack sudo[77096]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG cinder.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Notifying Schedulers of capabilities ... {{(pid=76259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:46:14 devstack cinder-volume[76259]: INFO cinder.volume.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Driver initialization completed successfully. Nov 05 10:46:14 devstack cinder-volume[76259]: INFO cinder.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Initiating service 2 cleanup Nov 05 10:46:14 devstack cinder-volume[76259]: INFO cinder.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Service 2 cleanup completed. Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG cinder.service [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Creating RPC server for service cinder-volume {{(pid=76259) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG cinder.service [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76259) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 10:46:14 devstack cinder-volume[76259]: INFO cinder.volume.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:14 devstack sudo[77100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:46:14 devstack sudo[77100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:14 devstack sudo[77100]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.292s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:14 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:14 devstack sudo[77104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:14 devstack sudo[77104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:15 devstack sudo[77104]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:15 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:15 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:15 devstack sudo[77108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:46:15 devstack sudo[77108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:15 devstack sudo[77108]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:15 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.288s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:15 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:46:15 devstack sudo[77114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:46:15 devstack sudo[77114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:46:15 devstack sudo[77114]: pam_unix(sudo:session): session closed for user root Nov 05 10:46:15 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:46:15 devstack cinder-volume[76259]: INFO cinder.volume.manager [None req-bfe0c8a7-7ac5-4c48-ad2a-8fc9f862de62 None None] Driver post RPC initialization completed successfully. Nov 05 10:46:17 devstack cinder-volume[76054]: DEBUG dbcounter [-] [76054] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76054) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:46:17 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager._thread_info {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:46:17 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread count: 6 {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:46:17 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread info: [<_MainThread(MainThread, started 123570353762432)>, , , , , ] {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:46:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:SELECT=3 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:46:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:47:17 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:47:17 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:47:17 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:47:17 devstack sudo[79073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:47:17 devstack sudo[79073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:47:18 devstack sudo[79073]: pam_unix(sudo:session): session closed for user root Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:47:18 devstack sudo[79076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:47:18 devstack sudo[79076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:47:18 devstack sudo[79076]: pam_unix(sudo:session): session closed for user root Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:47:18 devstack sudo[79079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:47:18 devstack sudo[79079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:47:18 devstack sudo[79079]: pam_unix(sudo:session): session closed for user root Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:47:18 devstack sudo[79082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:47:18 devstack sudo[79082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:47:18 devstack sudo[79082]: pam_unix(sudo:session): session closed for user root Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:47:18 devstack cinder-volume[76259]: DEBUG cinder.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Notifying Schedulers of capabilities ... {{(pid=76259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:47:19 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager._thread_info {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:47:19 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread count: 6 {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:47:19 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread info: [<_MainThread(MainThread, started 123570353762432)>, , , , , ] {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:48:17 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:48:17 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:48:17 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:48:17 devstack sudo[82404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:48:17 devstack sudo[82404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:48:18 devstack sudo[82404]: pam_unix(sudo:session): session closed for user root Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:48:18 devstack sudo[82423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:48:18 devstack sudo[82423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:48:18 devstack sudo[82423]: pam_unix(sudo:session): session closed for user root Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:48:18 devstack sudo[82426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:48:18 devstack sudo[82426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:48:18 devstack sudo[82426]: pam_unix(sudo:session): session closed for user root Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:48:18 devstack sudo[82430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:48:18 devstack sudo[82430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:48:18 devstack sudo[82430]: pam_unix(sudo:session): session closed for user root Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.254s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG cinder.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Notifying Schedulers of capabilities ... {{(pid=76259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager._thread_info {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread count: 6 {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:48:18 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread info: [<_MainThread(MainThread, started 123570353762432)>, , , , , ] {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:48:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:SELECT=1 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:48:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:UPDATE=1 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:49:17 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:49:17 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:49:17 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:49:17 devstack sudo[84402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:49:17 devstack sudo[84402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:49:18 devstack sudo[84402]: pam_unix(sudo:session): session closed for user root Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:49:18 devstack sudo[84421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:49:18 devstack sudo[84421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:49:18 devstack sudo[84421]: pam_unix(sudo:session): session closed for user root Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.314s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:49:18 devstack sudo[84426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:49:18 devstack sudo[84426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:49:18 devstack sudo[84426]: pam_unix(sudo:session): session closed for user root Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.353s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:49:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:49:18 devstack sudo[84438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:49:18 devstack sudo[84438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:49:19 devstack sudo[84438]: pam_unix(sudo:session): session closed for user root Nov 05 10:49:19 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.320s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:49:19 devstack cinder-volume[76259]: DEBUG cinder.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Notifying Schedulers of capabilities ... {{(pid=76259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:50:17 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:50:17 devstack cinder-volume[76259]: DEBUG cinder.volume.drivers.lvm [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Updating volume stats {{(pid=76259) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 05 10:50:17 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:17 devstack sudo[85588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 05 10:50:17 devstack sudo[85588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:18 devstack sudo[85588]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.293s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:18 devstack sudo[85591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:50:18 devstack sudo[85591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:18 devstack sudo[85591]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:18 devstack sudo[85594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 05 10:50:18 devstack sudo[85594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:18 devstack sudo[85594]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.296s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:18 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:18 devstack sudo[85620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 05 10:50:18 devstack sudo[85620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:19 devstack sudo[85620]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:19 devstack cinder-volume[76259]: DEBUG oslo_concurrency.processutils [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76259) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:19 devstack cinder-volume[76259]: DEBUG cinder.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Notifying Schedulers of capabilities ... {{(pid=76259) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:50:19 devstack cinder-volume[76259]: DEBUG oslo_service.periodic_task [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] Running periodic task VolumeManager._thread_info {{(pid=76259) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:50:19 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread count: 6 {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:50:19 devstack cinder-volume[76259]: DEBUG cinder.volume.manager [None req-40f30bc4-8a4f-4cee-ac85-05f50ab7a06a None None] thread info: [<_MainThread(MainThread, started 123570353762432)>, , , , , ] {{(pid=76259) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:50:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:SELECT=1 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:50:25 devstack cinder-volume[76259]: DEBUG dbcounter [-] [76259] Writing DB stats cinder:UPDATE=1 {{(pid=76259) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:50:53 devstack cinder-volume[76054]: INFO oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Caught SIGTERM, stopping children Nov 05 10:50:53 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Acquiring lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:50:53 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Acquired lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:50:53 devstack cinder-volume[76054]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Releasing lock "singleton_lock" {{(pid=76054) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:50:53 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Stop services. {{(pid=76054) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 10:50:53 devstack cinder-volume[76054]: DEBUG oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Killing children. {{(pid=76054) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 10:50:53 devstack cinder-volume[76054]: INFO oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Waiting on 1 children to exit Nov 05 10:50:54 devstack cinder-volume[76259]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Acquiring lock "singleton_lock" {{(pid=76259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:50:54 devstack cinder-volume[76259]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Acquired lock "singleton_lock" {{(pid=76259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:50:54 devstack cinder-volume[76259]: DEBUG oslo_concurrency.lockutils [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Releasing lock "singleton_lock" {{(pid=76259) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:50:54 devstack cinder-volume[76259]: WARNING amqp [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 10:50:54 devstack cinder-volume[76259]: WARNING amqp [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 10:50:54 devstack cinder-volume[76054]: INFO oslo_service.backend._eventlet.service [None req-bc37d15d-6395-4386-88fd-ffc414141e6a None None] Child 76259 exited with status 0 Nov 05 10:50:55 devstack cinder-volume[86335]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 10:50:55 devstack cinder-volume[86335]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 10:50:55 devstack cinder-volume[86335]: we strongly recommend against using it for new projects. Nov 05 10:50:55 devstack cinder-volume[86335]: If you are already using Eventlet, we recommend migrating to a different Nov 05 10:50:55 devstack cinder-volume[86335]: framework. For more detail see Nov 05 10:50:55 devstack cinder-volume[86335]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 10:50:55 devstack cinder-volume[86335]: import eventlet # noqa Nov 05 10:50:57 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:50:57 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:50:57 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:50:57 devstack cinder-volume[86335]: INFO dbcounter [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Registered counter for database cinder Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_db.sqlalchemy.engines [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG dbcounter [-] [86335] Writer thread running {{(pid=86335) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:50:58 devstack cinder-volume[86335]: INFO cinder.rpc [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 10:50:58 devstack cinder-volume[86335]: INFO cinder.rpc [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_db.sqlalchemy.engines [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:50:58 devstack cinder-volume[86335]: INFO cinder.volume.manager [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Determined volume DB was empty at startup. Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG cinder.volume.manager [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86335) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 10:50:58 devstack cinder-volume[86335]: INFO cinder.volume.manager [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 05 10:50:58 devstack cinder-volume[86335]: WARNING stevedore.named [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 10:50:58 devstack cinder-volume[86335]: WARNING castellan.key_manager [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:50:58 devstack cinder-volume[86335]: WARNING cinder.keymgr.conf_key_mgr [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:50:58 devstack cinder-volume[86335]: INFO cinder.volume.manager [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_db.sqlalchemy.engines [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86335) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:50:58 devstack cinder-volume[86335]: INFO oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Starting 1 workers Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Started child 86610 {{(pid=86335) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Full set of CONF: {{(pid=86335) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] ******************************************************************************** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Configuration options gathered from: {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] ================================================================================ {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] allow_availability_zone_fallback = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] allow_compression_on_image_upload = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] allowed_direct_url_schemes = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] api_rate_limit = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] auth_strategy = keystone {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_availability_zone = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_host = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_stats_polling_interval = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backup_api_class = cinder.backup.api.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backup_name_template = backup-%s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backup_use_same_host = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backup_use_temp_snapshot = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] chap_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] chap_username = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_internal_tenant_project_id = c0716896349e4cde8d37c0d577c200f5 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_internal_tenant_user_id = 7b9297ae0ecc440cb4e4343efb9e25ed {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cluster = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] compression_format = gzip {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] compute_api_class = cinder.compute.nova.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] config_dir = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] config_source = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] control_exchange = openstack {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] debug = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] default_availability_zone = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] default_group_type = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] default_volume_type = QuobyteHD {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] disk_geometry = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_client_cert = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_client_cert_key = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_data_namespace = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_ssl_cert_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_ssl_cert_verify = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] driver_use_ssl = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] enable_new_services = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] enable_unsupported_driver = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] enabled_backends = ['QuobyteHD'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] enforce_multipath_for_image_xfer = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] filter_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86610]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_api_insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_api_ssl_compression = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_ca_certificates_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_catalog_info = image:glance:publicURL {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_num_retries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance_request_timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] goodness_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] graceful_shutdown_timeout = 5 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] group_api_class = cinder.group.api.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] host = devstack {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_compress_on_upload = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_conversion_address_space_limit = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_conversion_cpu_limit = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_conversion_disable = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_introspection_address_space_limit = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_introspection_cpu_limit = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_upload_use_cinder_backend = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_upload_use_internal_tenant = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_volume_cache_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_volume_cache_max_count = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] image_volume_cache_max_size_gb = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] init_host_max_objects_retrieval = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] instance_format = [instance: %(uuid)s] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iscsi_target_flags = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iscsi_write_cache = on {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iser_helper = tgtadm {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iser_ip_address = 192.168.122.167 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iser_port = 3260 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_color = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_config_append = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_dir = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_options = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_rotate_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_rotate_interval_type = days {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] log_rotation_type = none {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] max_age = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] max_logfile_count = 30 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] max_logfile_size_mb = 200 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] max_over_subscription_ratio = 20.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] message_reap_interval = 86400 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] message_ttl = 2592000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] migration_create_volume_timeout_secs = 300 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] monkey_patch = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] monkey_patch_modules = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] my_ip = 192.168.122.167 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] no_snapshot_gb_quota = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] num_iser_scan_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] num_shell_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] num_volume_device_scan_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] nvmeof_conn_info_version = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] nvmet_ns_id = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] nvmet_port_id = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_max_limit = 1000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_ext_list = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_listen_port = 8776 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_use_ssl = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] osapi_volume_workers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] per_volume_size_limit = -1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] periodic_fuzzy_delay = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] periodic_interval = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] public_endpoint = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] publish_errors = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_backup_gigabytes = 1000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_backups = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_gigabytes = 1000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_groups = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_snapshots = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] quota_volumes = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] rate_limit_burst = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] rate_limit_except_level = CRITICAL {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] rate_limit_interval = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] reinit_driver_count = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] replication_device = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] report_discard_supported = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] report_interval = 120 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] reservation_clean_interval = 86400 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] reservation_expire = 86400 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] reserved_image_namespaces = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] reserved_percentage = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] rpc_response_timeout = 120 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] run_external_periodic_tasks = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] scst_target_driver = iscsi {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] scst_target_iqn_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_down_time = 720 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] shell_completion = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] snapshot_name_template = snapshot-%s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] split_loggers = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] state_path = /opt/stack/data/cinder {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] storage_availability_zone = nova {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] storage_protocol = iSCSI {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] syslog_log_facility = LOG_USER {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_helper = lioadm {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_ip_address = 192.168.122.167 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_port = 3260 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_protocol = iscsi {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] target_secondary_ip_addresses = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] trace_flags = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] transport_url = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] until_refresh = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_chap_auth = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_default_quota_class = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_journal = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_json = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_multipath_for_image_xfer = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_stderr = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] use_syslog = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] verify_glance_signatures = enabled {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_api_class = cinder.volume.api.API {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_backend_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_clear = zero {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_clear_ionice = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_clear_size = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_copy_bps_limit = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_dd_blocksize = 1M {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_name_template = volume-%s {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_service_inithost_offload = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volume_usage_audit_period = month {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] zoning_mode = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_concurrency.disable_process_locking = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.auth_section = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.auth_type = password {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.auth_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.cache = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.include_service_catalog = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.interface = public {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcache_username = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.region_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.service_type = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.backend = dogpile.cache.null {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.backend_argument = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.backend_expiration_time = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.config_prefix = cache.oslo {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.debug_cache_backend = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.enable_retry_client = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.enable_socket_keepalive = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.expiration_time = 600 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.hashclient_retry_attempts = 2 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_dead_retry = 300 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_pool_maxsize = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_sasl_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.proxies = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.redis_db = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.redis_server = localhost:6379 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.retry_attempts = 2 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.retry_delay = 0.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.socket_keepalive_count = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.socket_keepalive_idle = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.socket_keepalive_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.socket_timeout = 1.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.tls_allowed_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.tls_cafile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.tls_certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.tls_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.tls_keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cache.username = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] coordination.backend_url = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.asyncio_connection = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.asyncio_slave_connection = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.backend = sqlalchemy {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.connection = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.connection_debug = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.connection_parameters = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.connection_recycle_time = 3600 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.connection_trace = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.db_inc_retry_interval = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.db_max_retries = 20 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.db_max_retry_interval = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.db_retry_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.max_overflow = 50 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.max_pool_size = 5 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.max_retries = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.mysql_wsrep_sync_wait = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.pool_timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.retry_interval = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.slave_connection = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.sqlite_synchronous = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.synchronous_reader = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] database.use_db_reconnect = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_tracing.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.connection_string = messaging:// {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.es_doc_type = notification {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.es_scroll_size = 10000 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.es_scroll_time = 2m {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.filter_error_trace = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.hmac_keys = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.sentinel_service_name = mymaster {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.socket_timeout = 0.1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.trace_requests = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler.trace_sqlalchemy = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler_jaeger.process_tags = {} {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler_jaeger.service_name_prefix = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.remotefs [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86610) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] profiler_otlp.service_name_prefix = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.enforce_new_defaults = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.policy_default_rule = default {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.policy_file = policy.yaml {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.group = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.helper_command = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] privsep_osbrick.user = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.group = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.helper_command = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] cinder_sys_admin.user = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.auth_section = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.auth_type = password {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.cafile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.collect_timing = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.send_service_user_token = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.split_loggers = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.tls_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] service_user.tls_min_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.auth_section = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.auth_type = password {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.collect_timing = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.region_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.split_loggers = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.tls_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] glance.tls_min_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.backend_availability_zone = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.chap_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.chap_username = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.disk_geometry = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_client_cert = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_client_cert_key = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_data_namespace = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.driver_use_ssl = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.extra_capabilities = {} {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.filter_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.goodness_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iscsi_target_flags = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iscsi_write_cache = on {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iser_helper = tgtadm {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iser_port = 3260 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_host = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_login = admin {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_mount_options = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_private_key = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_share_path = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.num_shell_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.quobyte_volume_url = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.replication_device = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.report_discard_supported = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.reserved_percentage = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_helper = tgtadm {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_port = 3260 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_protocol = iscsi {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.trace_flags = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.unique_fqdn_network = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.use_chap_auth = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_backend_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_clear = zero {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_clear_ionice = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_clear_size = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_reports.file_event_handler = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_reports.log_dir = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.backend_availability_zone = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.backend_host = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.chap_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.chap_username = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.chiscsi_conf = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.disk_geometry = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_client_cert = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_data_namespace = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.driver_use_ssl = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.extra_capabilities = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.filter_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.goodness_function = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:58 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iser_helper = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iser_ip_address = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iser_port = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.iser_target_prefix = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_host = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_login = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_mount_options = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_password = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_private_key = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_share_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_ssh_port = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.num_shell_tries = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.nvmet_port_id = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.replication_device = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.report_discard_supported = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.reserved_percentage = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.scst_target_driver = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.storage_protocol = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_helper = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_ip_address = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_port = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_prefix = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_protocol = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.trace_flags = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.use_chap_auth = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_clear = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_clear_size = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] QuobyteHD.volumes_dir = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86610) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86610]: WARNING cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 10:50:59 devstack cinder-volume[86610]: WARNING cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Running cmd (subprocess): mount.quobyte {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_notifications.driver = [] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_notifications.retry = -1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] key_manager.fixed_key = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.barbican_api_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.barbican_endpoint = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.barbican_endpoint_type = public {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.barbican_region_name = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.cafile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.collect_timing = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.number_of_retries = 60 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.retry_delay = 1 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.send_service_user_token = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.split_loggers = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.tls_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.tls_min_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.verify_ssl = True {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican.verify_ssl_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.auth_section = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.auth_type = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.cafile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.certfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.collect_timing = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.insecure = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.keyfile = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.split_loggers = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.timeout = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.tls_ciphers = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] barbican_service_user.tls_min_version = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.approle_role_id = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.approle_secret_id = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.auth_method = approle {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.auth_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.kv_mountpoint = secret {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.kv_path = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.kv_version = 2 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.namespace = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.root_token_id = **** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.ssl_ca_crt_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.timeout = 60.0 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.token_file = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.token_role = None {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.use_ssl = False {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:50:59 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] ******************************************************************************** {{(pid=86335) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 10:50:59 devstack quobyte-client[86623]: Reading configuration file: /etc/quobyte/client.cfg Nov 05 10:50:59 devstack quobyte-client[86623]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] CMD "mount.quobyte" returned: 1 in 0.084s {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=86610) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:50:59 devstack cinder-volume[86610]: INFO cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb ... Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 -c /etc/quobyte/client-cinder.cfg {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:59 devstack sudo[86624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 -c /etc/quobyte/client-cinder.cfg Nov 05 10:50:59 devstack sudo[86624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:59 devstack sudo[86624]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.483s {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:59 devstack cinder-volume[86610]: INFO cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb succeeded Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=86610) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.494s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:50:59 devstack sudo[86734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:50:59 devstack sudo[86734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:50:59 devstack sudo[86734]: pam_unix(sudo:session): session closed for user root Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.263s {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:50:59 devstack cinder-volume[86610]: INFO cinder.volume.driver [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG cinder.volume.driver [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552612304688, 'free_capacity_gb': 1773.4552612304688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86610) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 10:50:59 devstack cinder-volume[86610]: DEBUG oslo_db.sqlalchemy.engines [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86610) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG dbcounter [-] [86610] Writer thread running {{(pid=86610) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.db.api [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Building query based on filter {{(pid=86610) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.image.image_utils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86610) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.keymgr.migration [None req-e044268a-4d83-49d1-8645-74329502ca64 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=86610) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=86610) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:00 devstack sudo[86745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:51:00 devstack sudo[86745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:51:00 devstack sudo[86745]: pam_unix(sudo:session): session closed for user root Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.247s {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Notifying Schedulers of capabilities ... {{(pid=86610) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Driver initialization completed successfully. Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Initiating service 3 cleanup Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Service 3 cleanup completed. Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.service [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Creating RPC server for service cinder-volume {{(pid=86610) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.service [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86610) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=86610) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG cinder.volume.drivers.quobyte [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=86610) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86610) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:00 devstack sudo[86756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:51:00 devstack sudo[86756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:51:00 devstack sudo[86756]: pam_unix(sudo:session): session closed for user root Nov 05 10:51:00 devstack cinder-volume[86610]: DEBUG oslo_concurrency.processutils [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.344s {{(pid=86610) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:00 devstack cinder-volume[86610]: INFO cinder.volume.manager [None req-704df7a1-55ae-4f45-a090-68b5785f4238 None None] Driver post RPC initialization completed successfully. Nov 05 10:51:05 devstack cinder-volume[86335]: INFO oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Caught SIGTERM, stopping children Nov 05 10:51:05 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Acquiring lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:51:05 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Acquired lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:51:05 devstack cinder-volume[86335]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Releasing lock "singleton_lock" {{(pid=86335) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:51:05 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Stop services. {{(pid=86335) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 05 10:51:05 devstack cinder-volume[86335]: DEBUG oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Killing children. {{(pid=86335) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 05 10:51:05 devstack cinder-volume[86335]: INFO oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Waiting on 1 children to exit Nov 05 10:51:08 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Acquiring lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:51:08 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Acquired lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:51:08 devstack cinder-volume[86610]: DEBUG oslo_concurrency.lockutils [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Releasing lock "singleton_lock" {{(pid=86610) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:51:08 devstack cinder-volume[86610]: WARNING amqp [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 10:51:08 devstack cinder-volume[86610]: WARNING amqp [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 05 10:51:08 devstack cinder-volume[86335]: INFO oslo_service.backend._eventlet.service [None req-9e547b34-c860-4fd6-86b0-f7c9a35e3789 None None] Child 86610 exited with status 0 Nov 05 10:51:09 devstack cinder-volume[87103]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 05 10:51:09 devstack cinder-volume[87103]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 10:51:09 devstack cinder-volume[87103]: we strongly recommend against using it for new projects. Nov 05 10:51:09 devstack cinder-volume[87103]: If you are already using Eventlet, we recommend migrating to a different Nov 05 10:51:09 devstack cinder-volume[87103]: framework. For more detail see Nov 05 10:51:09 devstack cinder-volume[87103]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 10:51:09 devstack cinder-volume[87103]: import eventlet # noqa Nov 05 10:51:12 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 05 10:51:12 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 05 10:51:12 devstack cinder-volume[87103]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=87103) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 05 10:51:13 devstack cinder-volume[87103]: INFO dbcounter [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Registered counter for database cinder Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG dbcounter [-] [87103] Writer thread running {{(pid=87103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:51:13 devstack cinder-volume[87103]: INFO cinder.rpc [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 05 10:51:13 devstack cinder-volume[87103]: INFO cinder.rpc [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:51:13 devstack cinder-volume[87103]: INFO cinder.volume.manager [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Determined volume DB was empty at startup. Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG cinder.volume.manager [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=87103) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 05 10:51:13 devstack cinder-volume[87103]: WARNING stevedore.named [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 05 10:51:13 devstack cinder-volume[87103]: WARNING castellan.key_manager [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:51:13 devstack cinder-volume[87103]: WARNING cinder.keymgr.conf_key_mgr [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 05 10:51:13 devstack cinder-volume[87103]: INFO cinder.volume.manager [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_db.sqlalchemy.engines [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87103) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:51:13 devstack cinder-volume[87103]: INFO oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Starting 1 workers Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Started child 87369 {{(pid=87103) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Full set of CONF: {{(pid=87103) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] ******************************************************************************** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] Configuration options gathered from: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] ================================================================================ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] allow_availability_zone_fallback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] allow_compression_on_image_upload = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] allowed_direct_url_schemes = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] api_rate_limit = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] auth_strategy = keystone {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_stats_polling_interval = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backup_api_class = cinder.backup.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backup_name_template = backup-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87369]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backup_use_same_host = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backup_use_temp_snapshot = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] chap_username = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_internal_tenant_project_id = c0716896349e4cde8d37c0d577c200f5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_internal_tenant_user_id = 7b9297ae0ecc440cb4e4343efb9e25ed {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cluster = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] compression_format = gzip {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] compute_api_class = cinder.compute.nova.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] config_dir = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] config_source = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] control_exchange = openstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] debug = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] default_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] default_group_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] default_volume_type = QuobyteHD {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_ssl_cert_verify = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] driver_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] enable_new_services = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] enable_unsupported_driver = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] enabled_backends = ['QuobyteHD'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] enforce_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_api_insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_api_servers = ['http://192.168.122.167/image'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_api_ssl_compression = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_ca_certificates_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_catalog_info = image:glance:publicURL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_num_retries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance_request_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] graceful_shutdown_timeout = 5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] group_api_class = cinder.group.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] host = devstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_compress_on_upload = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_conversion_address_space_limit = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_conversion_cpu_limit = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_conversion_disable = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_introspection_address_space_limit = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_introspection_cpu_limit = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_upload_use_cinder_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_upload_use_internal_tenant = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_volume_cache_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_volume_cache_max_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] image_volume_cache_max_size_gb = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] init_host_max_objects_retrieval = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] instance_format = [instance: %(uuid)s] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iscsi_target_flags = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iscsi_write_cache = on {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iser_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iser_ip_address = 192.168.122.167 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iser_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_color = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_config_append = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_options = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_rotate_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_rotate_interval_type = days {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] log_rotation_type = none {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] max_age = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] max_logfile_count = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] max_logfile_size_mb = 200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] max_over_subscription_ratio = 20.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] message_reap_interval = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] message_ttl = 2592000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] migration_create_volume_timeout_secs = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] monkey_patch = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] monkey_patch_modules = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] my_ip = 192.168.122.167 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] no_snapshot_gb_quota = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] num_iser_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] num_shell_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] num_volume_device_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] nvmeof_conn_info_version = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] nvmet_ns_id = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] nvmet_port_id = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_max_limit = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_ext_list = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_listen_port = 8776 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] osapi_volume_workers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] per_volume_size_limit = -1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] periodic_fuzzy_delay = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] periodic_interval = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] public_endpoint = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] publish_errors = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_backup_gigabytes = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_backups = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_gigabytes = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_groups = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_snapshots = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] quota_volumes = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] rate_limit_burst = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] rate_limit_except_level = CRITICAL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] rate_limit_interval = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] reinit_driver_count = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] report_discard_supported = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] report_interval = 120 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] reservation_clean_interval = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] reservation_expire = 86400 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] reserved_image_namespaces = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] reserved_percentage = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] rpc_response_timeout = 120 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] run_external_periodic_tasks = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] scst_target_driver = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_down_time = 720 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] shell_completion = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] snapshot_name_template = snapshot-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] state_path = /opt/stack/data/cinder {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] storage_availability_zone = nova {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] storage_protocol = iSCSI {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87369) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] syslog_log_facility = LOG_USER {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_helper = lioadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_ip_address = 192.168.122.167 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_protocol = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] target_secondary_ip_addresses = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] transport_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] until_refresh = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_chap_auth = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_default_quota_class = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_journal = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_json = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_stderr = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] use_syslog = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] verify_glance_signatures = enabled {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_api_class = cinder.volume.api.API {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_clear = zero {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_clear_size = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_copy_bps_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_dd_blocksize = 1M {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_name_template = volume-%s {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_service_inithost_offload = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volume_usage_audit_period = month {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] zoning_mode = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_concurrency.disable_process_locking = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.auth_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.include_service_catalog = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.interface = public {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcache_username = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.service_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.167/identity {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.backend = dogpile.cache.null {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.backend_argument = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.backend_expiration_time = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.config_prefix = cache.oslo {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.debug_cache_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.enable_retry_client = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.enable_socket_keepalive = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.expiration_time = 600 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.hashclient_retry_attempts = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_dead_retry = 300 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:13 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_pool_maxsize = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_sasl_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.proxies = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.redis_db = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.redis_server = localhost:6379 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.retry_attempts = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.retry_delay = 0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.socket_keepalive_count = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.socket_keepalive_idle = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.socket_keepalive_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.socket_timeout = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.tls_allowed_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.tls_cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.tls_certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.tls_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.tls_keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cache.username = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] coordination.backend_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.asyncio_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.asyncio_slave_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.backend = sqlalchemy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.connection_debug = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.connection_parameters = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.connection_recycle_time = 3600 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.connection_trace = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.db_inc_retry_interval = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.db_max_retries = 20 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.db_max_retry_interval = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.db_retry_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.max_overflow = 50 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.max_pool_size = 5 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.max_retries = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.mysql_wsrep_sync_wait = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.pool_timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.retry_interval = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.slave_connection = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.sqlite_synchronous = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.synchronous_reader = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] database.use_db_reconnect = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_tracing.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.connection_string = messaging:// {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.es_doc_type = notification {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.es_scroll_size = 10000 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.es_scroll_time = 2m {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.filter_error_trace = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.hmac_keys = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.sentinel_service_name = mymaster {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.socket_timeout = 0.1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.trace_requests = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler.trace_sqlalchemy = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler_jaeger.process_tags = {} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler_jaeger.service_name_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] profiler_otlp.service_name_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.enforce_new_defaults = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.policy_default_rule = default {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.policy_file = policy.yaml {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.group = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.helper_command = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] privsep_osbrick.user = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.group = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.helper_command = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] cinder_sys_admin.user = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.send_service_user_token = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.tls_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] service_user.tls_min_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.auth_type = password {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.tls_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] glance.tls_min_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.chap_username = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.driver_use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.extra_capabilities = {} {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iscsi_target_flags = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iscsi_write_cache = on {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iser_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iser_ip_address = 192.168.122.167 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iser_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_host = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_login = admin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_mount_options = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_private_key = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_share_path = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.num_shell_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87369) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.quobyte_volume_url = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.report_discard_supported = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.reserved_percentage = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_helper = tgtadm {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_ip_address = 192.168.122.167 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_port = 3260 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_protocol = iscsi {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.unique_fqdn_network = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.use_chap_auth = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Running cmd (subprocess): mount.quobyte {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_backend_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_clear = zero {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_clear_size = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_reports.file_event_handler = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_reports.log_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.backend_availability_zone = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.backend_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.chap_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.chap_username = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.chiscsi_conf = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.disk_geometry = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_client_cert = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_data_namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.driver_use_ssl = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.extra_capabilities = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.filter_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.goodness_function = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iser_helper = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iser_ip_address = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iser_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.iser_target_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_host = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_login = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_mount_options = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_password = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_private_key = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_share_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_ssh_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.num_shell_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.nvmet_port_id = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.replication_device = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.report_discard_supported = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.reserved_percentage = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.scst_target_driver = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.storage_protocol = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_helper = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_ip_address = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_port = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_prefix = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_protocol = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.trace_flags = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.use_chap_auth = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_clear = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_clear_size = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] QuobyteHD.volumes_dir = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_notifications.driver = [] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_notifications.retry = -1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] key_manager.fixed_key = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.barbican_api_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.barbican_endpoint = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.barbican_endpoint_type = public {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.barbican_region_name = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] CMD "mount.quobyte" returned: 1 in 0.109s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.number_of_retries = 60 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.retry_delay = 1 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.send_service_user_token = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.tls_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.tls_min_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.verify_ssl = True {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican.verify_ssl_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.auth_section = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.auth_type = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.cafile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.certfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.collect_timing = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.insecure = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.keyfile = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.split_loggers = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.timeout = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.tls_ciphers = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] barbican_service_user.tls_min_version = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.approle_role_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.approle_secret_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.auth_method = approle {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.auth_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.kv_mountpoint = secret {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.kv_path = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.kv_version = 2 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.namespace = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.root_token_id = **** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.ssl_ca_crt_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.timeout = 60.0 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.token_file = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.token_role = None {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.use_ssl = False {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 05 10:51:14 devstack cinder-volume[87103]: DEBUG oslo_service.backend._eventlet.service [None req-eb3b4ae2-6693-44d0-90d2-2a8db6c7eea3 None None] ******************************************************************************** {{(pid=87103) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 05 10:51:14 devstack sudo[87371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:51:14 devstack sudo[87371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:51:14 devstack sudo[87371]: pam_unix(sudo:session): session closed for user root Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.248s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.volume.driver [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Driver hasn't implemented _init_vendor_properties() Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.driver [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552612304688, 'free_capacity_gb': 1773.4552612304688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87369) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_db.sqlalchemy.engines [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87369) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writer thread running {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.db.api [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Building query based on filter {{(pid=87369) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3916}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87369) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.keymgr.migration [None req-8e57b0da-1949-44dd-8560-68c38ef1c086 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 05 10:51:14 devstack sudo[87375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:51:14 devstack sudo[87375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:51:14 devstack sudo[87375]: pam_unix(sudo:session): session closed for user root Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.237s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Driver initialization completed successfully. Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Initiating service 3 cleanup Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Service 3 cleanup completed. Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.service [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Creating RPC server for service cinder-volume {{(pid=87369) start /opt/stack/cinder/cinder/service.py:231}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.service [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87369) start /opt/stack/cinder/cinder/service.py:237}} Nov 05 10:51:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:51:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:51:14 devstack sudo[87378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:51:14 devstack sudo[87378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:51:15 devstack sudo[87378]: pam_unix(sudo:session): session closed for user root Nov 05 10:51:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.242s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:51:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-322a9aa5-830f-4924-beda-d32d438ed7d6 None None] Driver post RPC initialization completed successfully. Nov 05 10:51:23 devstack cinder-volume[87103]: DEBUG dbcounter [-] [87103] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=87103) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:51:24 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:51:25 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:51:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:51:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 6 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:51:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Flow 'volume_create_manager' (c5abebf8-ff27-44d0-9c6e-bf44bd23ac06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640df7d4-e382-4356-86fd-ef1e4081ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (640df7d4-e382-4356-86fd-ef1e4081ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-680034675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c1ea3a-5ab7-4539-a255-b2250da82c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8530754b2a470890c3eb53f10393ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:52:46Z,use_quota=True,user_id='8aa38f20c68c4e8aa0793d1236419363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05c1433-9352-41af-99d2-8a512edbf31a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05c1433-9352-41af-99d2-8a512edbf31a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98aead9-ec80-4ca2-867f-53161ff85588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f98aead9-ec80-4ca2-867f-53161ff85588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43c1ea3a-5ab7-4539-a255-b2250da82c20', 'volume_name': 'volume-43c1ea3a-5ab7-4539-a255-b2250da82c20', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b65ee-8930-4e94-bdfc-6db0aab8d1f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (514b65ee-8930-4e94-bdfc-6db0aab8d1f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746fa6d1-11e1-4e92-a86d-a1e3ee56250e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Volume 43c1ea3a-5ab7-4539-a255-b2250da82c20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43c1ea3a-5ab7-4539-a255-b2250da82c20', 'volume_size': 1} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-680034675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c1ea3a-5ab7-4539-a255-b2250da82c20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da8530754b2a470890c3eb53f10393ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:52:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:52:46Z,use_quota=True,user_id='8aa38f20c68c4e8aa0793d1236419363',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Creating volume 43c1ea3a-5ab7-4539-a255-b2250da82c20 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:52:46 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:52:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:47 devstack sudo[88083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 1073741824 Nov 05 10:52:47 devstack sudo[88083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:48 devstack sudo[88083]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 1073741824" returned: 0 in 1.147s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:48 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 Nov 05 10:52:48 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:48 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20" returned: 0 in 0.561s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] <== create_volume: return (1852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.859s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (746fa6d1-11e1-4e92-a86d-a1e3ee56250e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c1ea3a-5ab7-4539-a255-b2250da82c20', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87778f7f-741a-451b-a810-09e1d88573ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Volume volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 (43c1ea3a-5ab7-4539-a255-b2250da82c20): created successfully Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87778f7f-741a-451b-a810-09e1d88573ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Flow 'volume_create_manager' (c5abebf8-ff27-44d0-9c6e-bf44bd23ac06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:52:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7f38ef5a-7a1a-4582-a51a-5c2fde81be6b tempest-VolumesAdminNegativeTest-1115968611 None] Created volume successfully. Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Acquiring lock "cinder-43c1ea3a-5ab7-4539-a255-b2250da82c20-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "cinder-43c1ea3a-5ab7-4539-a255-b2250da82c20-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:52:50 devstack sudo[88435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:52:50 devstack sudo[88435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Acquiring lock "cinder-quobyte-43c1ea3a-5ab7-4539-a255-b2250da82c20" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "cinder-quobyte-43c1ea3a-5ab7-4539-a255-b2250da82c20" acquired by "delete_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:52:50 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmppec8udad/privsep.sock'] Nov 05 10:52:50 devstack sudo[88437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmppec8udad/privsep.sock Nov 05 10:52:50 devstack sudo[88437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:50 devstack sudo[88435]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.630s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 7 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:52:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Flow 'volume_create_manager' (7c2593a3-1d26-44f3-9d48-5fa5a4321ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e947d3c0-97d2-4e4f-a451-52a0489026c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e947d3c0-97d2-4e4f-a451-52a0489026c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-441221647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbffc5d-a88d-4a61-9371-4de102736c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4671d31db4543a494965b30160a16a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:52:52Z,use_quota=True,user_id='33d9bd5aa66149c8b17a05a4870aa8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42f76fc-bfe7-45b1-95c9-a3b8feda743a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f42f76fc-bfe7-45b1-95c9-a3b8feda743a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a6f663-56aa-4c3e-bacd-a9191390c2c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a6f663-56aa-4c3e-bacd-a9191390c2c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dbffc5d-a88d-4a61-9371-4de102736c08', 'volume_name': 'volume-3dbffc5d-a88d-4a61-9371-4de102736c08', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378877d3-2023-4094-98b8-4c1d5990584d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (378877d3-2023-4094-98b8-4c1d5990584d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937beceb-6b03-4380-85f6-9489fb881014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Volume 3dbffc5d-a88d-4a61-9371-4de102736c08: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dbffc5d-a88d-4a61-9371-4de102736c08', 'volume_size': 1} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:52:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-441221647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dbffc5d-a88d-4a61-9371-4de102736c08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4671d31db4543a494965b30160a16a2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:52:52Z,use_quota=True,user_id='33d9bd5aa66149c8b17a05a4870aa8df',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Creating volume 3dbffc5d-a88d-4a61-9371-4de102736c08 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:52:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:52:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:52 devstack sudo[88442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 1073741824 Nov 05 10:52:52 devstack sudo[88442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 05 10:52:52 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 05 10:52:53 devstack sudo[88442]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:53 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 05 10:52:53 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: Nov 05 10:52:53 devstack cinder-volume[87369]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 1073741824" returned: 0 in 0.949s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:53 devstack sudo[88448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 Nov 05 10:52:53 devstack sudo[88448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:53 devstack sudo[88437]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:53 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Spawned new privsep daemon via rootwrap Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Accepted privsep connection to /tmp/tmppec8udad/privsep.sock {{(pid=87369) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 05 10:52:53 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 05 10:52:53 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 05 10:52:53 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 05 10:52:53 devstack cinder-volume[87369]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88447 Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[49baf3ee-16d0-400d-b71f-fda350dccec5]: (2,) {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d35bbc-b1b2-4c87-b807-9f80eb0c523d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:53 devstack sudo[88448]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:53 devstack sudo[88451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 Nov 05 10:52:53 devstack sudo[88451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08" returned: 0 in 0.590s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.698s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (937beceb-6b03-4380-85f6-9489fb881014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dbffc5d-a88d-4a61-9371-4de102736c08', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515251d-d399-4f1c-94f6-23c9a57c6ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:52:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Volume volume-3dbffc5d-a88d-4a61-9371-4de102736c08 (3dbffc5d-a88d-4a61-9371-4de102736c08): created successfully Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7515251d-d399-4f1c-94f6-23c9a57c6ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:52:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Flow 'volume_create_manager' (7c2593a3-1d26-44f3-9d48-5fa5a4321ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:52:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6216a71d-4de0-4fe9-aaa5-b441fc3b8d87 tempest-ServerRescueNegativeTestJSON-1721326943 None] Created volume successfully. Nov 05 10:52:54 devstack sudo[88451]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20" returned: 0 in 0.920s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:54 devstack sudo[88458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20 Nov 05 10:52:54 devstack sudo[88458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:54 devstack sudo[88458]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-43c1ea3a-5ab7-4539-a255-b2250da82c20" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "cinder-quobyte-43c1ea3a-5ab7-4539-a255-b2250da82c20" released by "delete_volume" :: held 4.291s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:52:54 devstack cinder-volume[87369]: WARNING cinder.quota [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:52:54 devstack cinder-volume[87369]: WARNING cinder.quota [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:52:54 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Created reservations ['2b34014c-c314-44df-a0bd-3d34e9b8b0b0', '1d92f2e0-2210-42b2-b15c-aee44cebfb83', '5e67276a-7d87-4b81-8963-06004cc0deb4', '825140d2-47c4-4538-bb7c-648081976295'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:52:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:52:55 devstack sudo[88461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:52:55 devstack sudo[88461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:52:56 devstack sudo[88461]: pam_unix(sudo:session): session closed for user root Nov 05 10:52:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.984s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:52:56 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:52:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Deleted volume successfully. Nov 05 10:52:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9dc6072b-269f-405b-b65d-6e42c011cafc tempest-VolumesAdminNegativeTest-1115968611 None] Lock "cinder-43c1ea3a-5ab7-4539-a255-b2250da82c20-delete_volume" released by "delete_volume" :: held 5.935s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:05 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=11,cinder:INSERT=2,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:53:06 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=7,cinder:UPDATE=14,cinder:DELETE=2,cinder:INSERT=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Acquiring lock "cinder-3dbffc5d-a88d-4a61-9371-4de102736c08-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "cinder-3dbffc5d-a88d-4a61-9371-4de102736c08-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Acquiring lock "cinder-quobyte-3dbffc5d-a88d-4a61-9371-4de102736c08" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "cinder-quobyte-3dbffc5d-a88d-4a61-9371-4de102736c08" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb95a0e6-8cd0-4885-909b-97e6d510e436]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:53:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:12 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 Nov 05 10:53:12 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:13 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08" returned: 0 in 0.750s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:13 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08 Nov 05 10:53:13 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:14 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3dbffc5d-a88d-4a61-9371-4de102736c08" returned: 0 in 0.688s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "cinder-quobyte-3dbffc5d-a88d-4a61-9371-4de102736c08" released by "delete_volume" :: held 1.579s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Created reservations ['8ee09397-f4fb-451c-b219-d6379e3d21f6', '85a5dd8d-c3c6-463d-8267-17c373604b93', 'f860e5b3-b23e-4a00-971c-6e67f59f6523', 'cfe091a3-32f1-478e-8732-16efcedf8ccf'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:14 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:53:14 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:14 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.451s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:53:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Deleted volume successfully. Nov 05 10:53:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-babed5e5-1ab0-4280-b7f1-1774636c206a tempest-ServerRescueNegativeTestJSON-1721326943 None] Lock "cinder-3dbffc5d-a88d-4a61-9371-4de102736c08-delete_volume" released by "delete_volume" :: held 2.612s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (07faf596-568f-4f15-9a04-7f249b9661fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b815229f-e5fa-40d4-9b50-c2386e1b8bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b815229f-e5fa-40d4-9b50-c2386e1b8bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2079233345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235ed90-6e8c-4165-8aa3-694dc372d2bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:18Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110a5470-e00f-4576-a3fd-189627997aee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (110a5470-e00f-4576-a3fd-189627997aee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a1ce5a-ef5c-4b23-bdba-1214b24489a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00a1ce5a-ef5c-4b23-bdba-1214b24489a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1235ed90-6e8c-4165-8aa3-694dc372d2bf', 'volume_name': 'volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c6bdfe-8c57-402d-9508-4e7d0aad0894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5c6bdfe-8c57-402d-9508-4e7d0aad0894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2be0e-e9ea-4500-be97-d8b3e6f89fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Volume 1235ed90-6e8c-4165-8aa3-694dc372d2bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf', 'volume_size': 1} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2079233345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1235ed90-6e8c-4165-8aa3-694dc372d2bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:18Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Creating volume 1235ed90-6e8c-4165-8aa3-694dc372d2bf {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:18 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:18 devstack sudo[88746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf 1073741824 Nov 05 10:53:18 devstack sudo[88746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (8e3bd434-0173-4748-afab-2e73d60068c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24911db-272c-417f-84da-c0a9fe3b8aa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b24911db-272c-417f-84da-c0a9fe3b8aa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-485341346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd7f6a2-0ea5-4d36-b09d-5c936952c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:19Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3620ecd-8bf5-4aeb-ac99-6a9ba95e4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3620ecd-8bf5-4aeb-ac99-6a9ba95e4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a77a6-421f-4982-a405-69ef291c313b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (330a77a6-421f-4982-a405-69ef291c313b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dd7f6a2-0ea5-4d36-b09d-5c936952c804', 'volume_name': 'volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967719c8-a508-4410-bb5a-b9372df7954b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (967719c8-a508-4410-bb5a-b9372df7954b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7c9a34-8cd5-49fd-9bfe-0999c339a409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Volume 1dd7f6a2-0ea5-4d36-b09d-5c936952c804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804', 'volume_size': 1} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:19 devstack sudo[88746]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf 1073741824" returned: 0 in 0.996s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:19 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf Nov 05 10:53:19 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:19 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] <== create_volume: return (1383ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.542s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-485341346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dd7f6a2-0ea5-4d36-b09d-5c936952c804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:19Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Creating volume 1dd7f6a2-0ea5-4d36-b09d-5c936952c804 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:19 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:19 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 1073741824 Nov 05 10:53:19 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9d2be0e-e9ea-4500-be97-d8b3e6f89fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0ca7d-d27f-4193-aeae-365ea8b533b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Volume volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf (1235ed90-6e8c-4165-8aa3-694dc372d2bf): created successfully Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eb0ca7d-d27f-4193-aeae-365ea8b533b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (07faf596-568f-4f15-9a04-7f249b9661fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bea63598-3774-45de-9b74-10ef8bc94682 tempest-VolumesTestJSON-1331229554 None] Created volume successfully. Nov 05 10:53:20 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 1073741824" returned: 0 in 0.672s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:20 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 Nov 05 10:53:20 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:20 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" returned: 0 in 0.457s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.205s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e7c9a34-8cd5-49fd-9bfe-0999c339a409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb7eba-f6c4-445a-9cb2-a49418a2c780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:20 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Volume volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 (1dd7f6a2-0ea5-4d36-b09d-5c936952c804): created successfully Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6bb7eba-f6c4-445a-9cb2-a49418a2c780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (8e3bd434-0173-4748-afab-2e73d60068c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bfaf4c22-ea31-47d6-8139-851fae76cfd9 tempest-AttachVolumeTestJSON-1751119558 None] Created volume successfully. Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (acc56398-0e52-4949-8366-5e1a93574a55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13b6beb-c3a0-4d93-b404-47ba037b8cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c13b6beb-c3a0-4d93-b404-47ba037b8cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-986021544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b856607-2be8-4ee1-ba5b-cec391edb09a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:21Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9f9eb5-78be-4f80-aa9c-eb556282f7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a9f9eb5-78be-4f80-aa9c-eb556282f7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83048658-d9a6-40f8-9d54-befc1dd9eaae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83048658-d9a6-40f8-9d54-befc1dd9eaae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b856607-2be8-4ee1-ba5b-cec391edb09a', 'volume_name': 'volume-2b856607-2be8-4ee1-ba5b-cec391edb09a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0578b8a-ab58-498d-bf5a-addda136aa7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0578b8a-ab58-498d-bf5a-addda136aa7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79c0b5-2cef-49d8-a6d0-e575accedc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:21 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Volume 2b856607-2be8-4ee1-ba5b-cec391edb09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b856607-2be8-4ee1-ba5b-cec391edb09a', 'volume_size': 1} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-986021544',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b856607-2be8-4ee1-ba5b-cec391edb09a,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:21Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Creating volume 2b856607-2be8-4ee1-ba5b-cec391edb09a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:21 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:21 devstack sudo[88793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a 1073741824 Nov 05 10:53:21 devstack sudo[88793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:21 devstack sudo[88793]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a 1073741824" returned: 0 in 0.612s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:21 devstack sudo[88799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a Nov 05 10:53:21 devstack sudo[88799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:22 devstack sudo[88799]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed79c0b5-2cef-49d8-a6d0-e575accedc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b856607-2be8-4ee1-ba5b-cec391edb09a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8293ad7-de81-49be-994f-ddc51f5fec21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:22 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Volume volume-2b856607-2be8-4ee1-ba5b-cec391edb09a (2b856607-2be8-4ee1-ba5b-cec391edb09a): created successfully Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8293ad7-de81-49be-994f-ddc51f5fec21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (acc56398-0e52-4949-8366-5e1a93574a55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-08a57683-be50-45f3-ab86-fdcf4929995a tempest-VolumesTestJSON-1331229554 None] Created volume successfully. Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (608f3d73-6613-47b3-8698-85698867b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4c64a5-0966-4cd1-bfee-6b66518a979b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4c64a5-0966-4cd1-bfee-6b66518a979b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013402989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e55fcf6-29f1-4e22-988c-bac47c3f7278,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:24Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6fefb9-1b57-4a8a-a78c-3ab00d6c6ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a6fefb9-1b57-4a8a-a78c-3ab00d6c6ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef676742-f079-4408-b087-45a4d01127a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef676742-f079-4408-b087-45a4d01127a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e55fcf6-29f1-4e22-988c-bac47c3f7278', 'volume_name': 'volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fba772-2a07-4923-894d-3046ae5c5aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33fba772-2a07-4923-894d-3046ae5c5aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7068fa51-9f99-4cab-974e-a4db623388ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Volume 5e55fcf6-29f1-4e22-988c-bac47c3f7278: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278', 'volume_size': 1} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2013402989',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e55fcf6-29f1-4e22-988c-bac47c3f7278,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='4e4c61888f7c4a6f9c7e08eca9cb41ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:24Z,use_quota=True,user_id='0e790005a86a415ba0035047cde62149',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Creating volume 5e55fcf6-29f1-4e22-988c-bac47c3f7278 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:24 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:24 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 1073741824 Nov 05 10:53:24 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:24 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 1073741824" returned: 0 in 0.648s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:25 devstack sudo[88823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 Nov 05 10:53:25 devstack sudo[88823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:25 devstack sudo[88823]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278" returned: 0 in 0.373s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7068fa51-9f99-4cab-974e-a4db623388ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b721c86-ff13-408e-91cb-97024ec0d7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Volume volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 (5e55fcf6-29f1-4e22-988c-bac47c3f7278): created successfully Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b721c86-ff13-408e-91cb-97024ec0d7e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Flow 'volume_create_manager' (608f3d73-6613-47b3-8698-85698867b050) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-655419d8-2cb6-4edf-bf97-e6bd7673436b tempest-VolumesTestJSON-1331229554 None] Created volume successfully. Nov 05 10:53:25 devstack cinder-volume[87369]: WARNING py.warnings [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] /opt/stack/cinder/cinder/db/api.py:2442: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Nov 05 10:53:25 devstack cinder-volume[87369]: .first() Nov 05 10:53:25 devstack cinder-volume[87369]: Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2824e132-72b0-4761-9dd4-19aec6f21652', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:53:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-a0e13218-58e7-4f22-a980-d87ca1e20432 req-1f544177-f996-4a30-a7aa-2858d17d4950 tempest-AttachVolumeTestJSON-1751119558 None] attachment_update completed successfully. Nov 05 10:53:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-5e55fcf6-29f1-4e22-988c-bac47c3f7278-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-5e55fcf6-29f1-4e22-988c-bac47c3f7278-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-quobyte-5e55fcf6-29f1-4e22-988c-bac47c3f7278" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-5e55fcf6-29f1-4e22-988c-bac47c3f7278" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[487ea5e4-74d6-4808-bdaf-e4fc663dc5a7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:28 devstack sudo[89257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 Nov 05 10:53:28 devstack sudo[89257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:28 devstack sudo[89257]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278" returned: 0 in 0.652s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:28 devstack sudo[89268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278 Nov 05 10:53:28 devstack sudo[89268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:28 devstack sudo[89268]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5e55fcf6-29f1-4e22-988c-bac47c3f7278" returned: 0 in 0.273s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-5e55fcf6-29f1-4e22-988c-bac47c3f7278" released by "delete_volume" :: held 1.003s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Created reservations ['ffef2717-d100-48f4-892d-150cde82bd6c', '757aa785-a902-423d-aff9-e768f594b0ec', '25592031-3396-4af0-b4a8-af88cd174e3f', 'a319ce63-8881-49d5-9bee-945e0883febd'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:29 devstack sudo[89271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:53:29 devstack sudo[89271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:29 devstack sudo[89271]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.312s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:53:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Deleted volume successfully. Nov 05 10:53:29 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-437cb4ec-0073-4e07-9d92-7aa553009826 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-5e55fcf6-29f1-4e22-988c-bac47c3f7278-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-2b856607-2be8-4ee1-ba5b-cec391edb09a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-2b856607-2be8-4ee1-ba5b-cec391edb09a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-quobyte-2b856607-2be8-4ee1-ba5b-cec391edb09a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-2b856607-2be8-4ee1-ba5b-cec391edb09a" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6bfa25-99bc-4dc3-b49a-3fc0f86d442a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:53:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:30 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a Nov 05 10:53:30 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:31 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a" returned: 0 in 0.550s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:31 devstack sudo[89282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a Nov 05 10:53:31 devstack sudo[89282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:31 devstack sudo[89282]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b856607-2be8-4ee1-ba5b-cec391edb09a" returned: 0 in 0.366s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-2b856607-2be8-4ee1-ba5b-cec391edb09a" released by "delete_volume" :: held 0.976s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Created reservations ['83bea876-7494-4840-af75-64f5c05e0f41', 'b5ce973f-d102-4cc8-80c4-cfd4fcdc7128', '379dcb8f-05da-4141-bb88-3aeacbf3dde3', '85ef53b5-90e1-4874-9083-bfec91bf9287'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:31 devstack sudo[89326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:53:31 devstack sudo[89326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:32 devstack sudo[89326]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.431s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:53:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Deleted volume successfully. Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1580f77c-8106-478f-acb7-db1ac08b9f97 tempest-VolumesTestJSON-1331229554 None] Lock "cinder-2b856607-2be8-4ee1-ba5b-cec391edb09a-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-1235ed90-6e8c-4165-8aa3-694dc372d2bf-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "cinder-1235ed90-6e8c-4165-8aa3-694dc372d2bf-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Acquiring lock "cinder-quobyte-1235ed90-6e8c-4165-8aa3-694dc372d2bf" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:53:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-1235ed90-6e8c-4165-8aa3-694dc372d2bf" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:53:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7fcbf5-ce19-4867-a942-34766d842164]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:53:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:33 devstack sudo[89445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf Nov 05 10:53:33 devstack sudo[89445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:33 devstack sudo[89445]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf" returned: 0 in 0.757s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:33 devstack sudo[89813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf Nov 05 10:53:33 devstack sudo[89813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:34 devstack sudo[89813]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1235ed90-6e8c-4165-8aa3-694dc372d2bf" returned: 0 in 0.496s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "cinder-quobyte-1235ed90-6e8c-4165-8aa3-694dc372d2bf" released by "delete_volume" :: held 1.356s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Created reservations ['2f1fdf0e-7a12-47e2-8295-6c5789b03479', 'f3b26f65-8e93-4a58-a7e3-23a83a7117fd', '39086cbf-a889-4f84-b14d-68fe28ad5396', '5dacb494-6e1b-4c43-8214-ce478c2bd854'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:34 devstack sudo[89833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:53:34 devstack sudo[89833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:35 devstack sudo[89833]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.372s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:35 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:53:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Deleted volume successfully. Nov 05 10:53:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e5d33849-2ebf-4d09-b572-e169da2c51ce tempest-VolumesTestJSON-1331229554 None] Lock "cinder-1235ed90-6e8c-4165-8aa3-694dc372d2bf-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:53:44 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=39,cinder:INSERT=8,cinder:UPDATE=45,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:53:45 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=31,cinder:UPDATE=47,cinder:INSERT=12,cinder:DELETE=3 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:53:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8fd0968f-a2e7-4b69-a00c-5ad4833b8c97 tempest-GroupSnapshotsV319Test-1815270957 None] Group tempest-GroupSnapshotsV319Test-Group-935402137: creating Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8fd0968f-a2e7-4b69-a00c-5ad4833b8c97 tempest-GroupSnapshotsV319Test-1815270957 None] Group tempest-GroupSnapshotsV319Test-Group-935402137: created successfully Nov 05 10:53:50 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:53:50 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8fd0968f-a2e7-4b69-a00c-5ad4833b8c97 tempest-GroupSnapshotsV319Test-1815270957 None] Create group completed successfully. Nov 05 10:53:50 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.317s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 8 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:53:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Flow 'volume_create_manager' (a0090ebb-0f58-48b9-bae0-8ab90598bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ba27a-72d7-48ea-a824-4c253d91e60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (044ba27a-72d7-48ea-a824-4c253d91e60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1849823031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e625b9b2-9b4c-4d62-b6a7-30a0bdece82c,host='devstack@QuobyteHD#QuobyteHD',id=8abec4f0-5379-46ad-9a0a-6bcfe157c127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b98bd9c504b46878e8c9538ee16d4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:53Z,use_quota=True,user_id='7b09decfd24c45ddaeab08b9fddaabb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b6f5cb6-ce87-43dd-aba5-218a72c76d60),volume_type_id=5b6f5cb6-ce87-43dd-aba5-218a72c76d60)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5ee8e9-fc1d-4b09-baa0-f1c5356522c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd5ee8e9-fc1d-4b09-baa0-f1c5356522c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6435df-4382-4a5e-94fc-e27fbade57be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f6435df-4382-4a5e-94fc-e27fbade57be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8abec4f0-5379-46ad-9a0a-6bcfe157c127', 'volume_name': 'volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62092df-cfcd-407f-94c0-77e310b46486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a62092df-cfcd-407f-94c0-77e310b46486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd552003-7573-44c8-bbd6-27a343bc828a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Volume 8abec4f0-5379-46ad-9a0a-6bcfe157c127: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127', 'volume_size': 1} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e625b9b2-9b4c-4d62-b6a7-30a0bdece82c,created_at=2026-11-05T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1849823031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e625b9b2-9b4c-4d62-b6a7-30a0bdece82c,host='devstack@QuobyteHD#QuobyteHD',id=8abec4f0-5379-46ad-9a0a-6bcfe157c127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9b98bd9c504b46878e8c9538ee16d4d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:53Z,use_quota=True,user_id='7b09decfd24c45ddaeab08b9fddaabb7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b6f5cb6-ce87-43dd-aba5-218a72c76d60),volume_type_id=5b6f5cb6-ce87-43dd-aba5-218a72c76d60)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Creating volume 8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:52 devstack sudo[89967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 1073741824 Nov 05 10:53:52 devstack sudo[89967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:53 devstack sudo[89967]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 1073741824" returned: 0 in 0.833s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:53 devstack sudo[89980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 Nov 05 10:53:53 devstack sudo[89980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:54 devstack sudo[89980]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127" returned: 0 in 0.712s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] <== create_volume: return (1615ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd552003-7573-44c8-bbd6-27a343bc828a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ddd5e4-0f61-4030-bb16-fbf1171827ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Volume volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 (8abec4f0-5379-46ad-9a0a-6bcfe157c127): created successfully Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6ddd5e4-0f61-4030-bb16-fbf1171827ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Flow 'volume_create_manager' (a0090ebb-0f58-48b9-bae0-8ab90598bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-49c97be4-0997-48ce-bfc6-9df95f47f350 tempest-GroupSnapshotsV319Test-1815270957 None] Created volume successfully. Nov 05 10:53:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] GroupSnapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: creating. Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Group snapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: creating. {{(pid=87369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Creating offline snapshot 95d97a12-3eae-491a-a5b6-f88b7500b956 of volume 8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b18d18-5bdd-4547-af6f-ffb4836a3744]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:53:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:56 devstack sudo[89987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 Nov 05 10:53:56 devstack sudo[89987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:57 devstack sudo[89987]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127" returned: 0 in 0.821s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:57 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 1G Nov 05 10:53:57 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:57 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 1G" returned: 0 in 0.768s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:57 devstack sudo[89999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 Nov 05 10:53:57 devstack sudo[89999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:58 devstack sudo[89999]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956" returned: 0 in 0.550s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:58 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:58 devstack sudo[90005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 Nov 05 10:53:58 devstack sudo[90005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:58 devstack sudo[90005]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:58 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info Nov 05 10:53:58 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Flow 'volume_create_manager' (0f72e814-88a5-4e36-bc6b-969a3c799344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9a4e08-a906-4026-8eb1-bd5e932e5fc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c9a4e08-a906-4026-8eb1-bd5e932e5fc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1019032068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30db1b-ee39-425c-b8d7-375a550e8e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a9e224a18e47bfb39aa96dca4927c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:59Z,use_quota=True,user_id='6cf43b90266d42e1b264de99731a2565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22adeab9-2200-480c-9ef4-47e72f2837e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22adeab9-2200-480c-9ef4-47e72f2837e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1219379-f5fd-436c-9597-eb04a4f345a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1219379-f5fd-436c-9597-eb04a4f345a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd30db1b-ee39-425c-b8d7-375a550e8e09', 'volume_name': 'volume-dd30db1b-ee39-425c-b8d7-375a550e8e09', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dd30a5-53ac-49eb-9b8b-f77f81bc54a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51dd30a5-53ac-49eb-9b8b-f77f81bc54a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00337f8b-804e-4cad-95a7-118ba953ad3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:53:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Volume dd30db1b-ee39-425c-b8d7-375a550e8e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd30db1b-ee39-425c-b8d7-375a550e8e09', 'volume_size': 1} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:59 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:59 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:59 devstack sudo[90011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info Nov 05 10:53:59 devstack sudo[90011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:59 devstack sudo[90011]: pam_unix(sudo:session): session closed for user root Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.info" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.338s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:53:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1019032068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd30db1b-ee39-425c-b8d7-375a550e8e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1a9e224a18e47bfb39aa96dca4927c0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:53:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:53:59Z,use_quota=True,user_id='6cf43b90266d42e1b264de99731a2565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Creating volume dd30db1b-ee39-425c-b8d7-375a550e8e09 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:53:59 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:53:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:53:59 devstack sudo[90014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 1073741824 Nov 05 10:53:59 devstack sudo[90014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:53:59 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-229f890e-943f-459a-ab6f-d31d34dd52f9 tempest-GroupSnapshotsV319Test-1815270957 None] group_snapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: created successfully Nov 05 10:54:00 devstack sudo[90014]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 1073741824" returned: 0 in 0.513s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:00 devstack sudo[90019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 Nov 05 10:54:00 devstack sudo[90019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:00 devstack sudo[90019]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09" returned: 0 in 0.271s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00337f8b-804e-4cad-95a7-118ba953ad3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd30db1b-ee39-425c-b8d7-375a550e8e09', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d989d2c-af85-4585-af9f-8f8ec7acb1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Volume volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 (dd30db1b-ee39-425c-b8d7-375a550e8e09): created successfully Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d989d2c-af85-4585-af9f-8f8ec7acb1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Flow 'volume_create_manager' (0f72e814-88a5-4e36-bc6b-969a3c799344) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-29485822-cda2-4f1a-827c-e18e2c484c34 tempest-DeleteServersTestJSON-1572819524 None] Created volume successfully. Nov 05 10:54:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] group_snapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: deleting Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] group_snapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: deleting {{(pid=87369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-b083c143-416b-4a3b-a926-738e5477d79f req-3370c715-64d1-4b2a-b91c-8557d42f6668 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-b083c143-416b-4a3b-a926-738e5477d79f req-3370c715-64d1-4b2a-b91c-8557d42f6668 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-b083c143-416b-4a3b-a926-738e5477d79f req-3370c715-64d1-4b2a-b91c-8557d42f6668 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-0e0d6cbc-a57b-4f6a-8c3b-c9ab0e4fa1f6 req-dede4ac5-0759-4347-bef7-77dd869c6e60 tempest-AttachVolumeTestJSON-1751119558 None] Terminate volume connection completed successfully. Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-0e0d6cbc-a57b-4f6a-8c3b-c9ab0e4fa1f6 req-dede4ac5-0759-4347-bef7-77dd869c6e60 tempest-AttachVolumeTestJSON-1751119558 None] Deleting attachment 2824e132-72b0-4761-9dd4-19aec6f21652. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "cinder-quobyte-95d97a12-3eae-491a-a5b6-f88b7500b956" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-95d97a12-3eae-491a-a5b6-f88b7500b956" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Deleting offline snapshot 95d97a12-3eae-491a-a5b6-f88b7500b956 of volume 8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] snapshot_file for this snap is: volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d432b19-2b97-4a94-a587-37e22aa81656]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-b083c143-416b-4a3b-a926-738e5477d79f req-3370c715-64d1-4b2a-b91c-8557d42f6668 tempest-DeleteServersTestJSON-1572819524 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-dd30db1b-ee39-425c-b8d7-375a550e8e09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce76259a-d8de-4953-853d-25b39c7c4df7', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:54:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-b083c143-416b-4a3b-a926-738e5477d79f req-3370c715-64d1-4b2a-b91c-8557d42f6668 tempest-DeleteServersTestJSON-1572819524 None] attachment_update completed successfully. Nov 05 10:54:02 devstack sudo[90045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 Nov 05 10:54:02 devstack sudo[90045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:03 devstack sudo[90045]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956" returned: 0 in 1.017s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:03 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb865ee6-23cc-4fcd-bd85-9251d94ba850]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:03 devstack sudo[90474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 Nov 05 10:54:03 devstack sudo[90474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:04 devstack sudo[90474]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127" returned: 0 in 0.717s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:04 devstack sudo[90485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 Nov 05 10:54:04 devstack sudo[90485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:04 devstack sudo[90485]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956" returned: 0 in 0.401s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:04 devstack sudo[90490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956 Nov 05 10:54:04 devstack sudo[90490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:04 devstack sudo[90490]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127.95d97a12-3eae-491a-a5b6-f88b7500b956" returned: 0 in 0.319s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-95d97a12-3eae-491a-a5b6-f88b7500b956" released by "_delete_snapshot" :: held 2.659s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" released by "delete_snapshot" :: held 2.696s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:05 devstack cinder-volume[87369]: WARNING cinder.quota [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-427732206 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-427732206, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:54:05 devstack cinder-volume[87369]: WARNING cinder.quota [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-427732206 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-427732206, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:54:05 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] Created reservations ['72ba8ba2-6fd5-45b7-a848-0ec6547e7179', 'f163dd05-4fe3-462f-b62b-bdd60478b6de', '46f67c10-452c-404c-b15a-feea60834420', 'ae585cf3-046b-4459-9d85-db61d2b617e3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e21242e2-0fdc-4bea-9f5a-8c590be41501 tempest-GroupSnapshotsV319Test-1815270957 None] group_snapshot cf64f3c8-752f-46ef-afdb-17049a9d4635: deleted successfully Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cffcd8-0924-4b93-9844-0dbc3911ec63]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:07 devstack sudo[90558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 Nov 05 10:54:07 devstack sudo[90558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:07 devstack sudo[90558]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127" returned: 0 in 0.521s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:07 devstack sudo[90570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127 Nov 05 10:54:07 devstack sudo[90570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:08 devstack sudo[90570]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8abec4f0-5379-46ad-9a0a-6bcfe157c127" returned: 0 in 0.475s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Lock "cinder-quobyte-8abec4f0-5379-46ad-9a0a-6bcfe157c127" released by "delete_volume" :: held 1.130s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Created reservations ['dada556f-14cd-4241-b106-f9f31fc26ceb'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:08 devstack cinder-volume[87369]: WARNING cinder.quota [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-427732206 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-427732206, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Created reservations ['bf4c6ab6-34ff-4050-afeb-25e395816adb', '7a8b184e-c1ef-48c6-9e69-82b6ba5fed32', '8895f0c3-1480-4dd6-a311-dd774109fca1', 'eb2d3774-0f1d-4961-9f87-49bb9c6668e4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:08 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:54:08 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-d01e7e35-f8f5-4805-94c4-9c46493850f9 req-a7a96808-376c-4d88-b3d8-93b4ee2b0f44 tempest-DeleteServersTestJSON-1572819524 None] Terminate volume connection completed successfully. Nov 05 10:54:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-d01e7e35-f8f5-4805-94c4-9c46493850f9 req-a7a96808-376c-4d88-b3d8-93b4ee2b0f44 tempest-DeleteServersTestJSON-1572819524 None] Deleting attachment ce76259a-d8de-4953-853d-25b39c7c4df7. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:54:09 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.604s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:09 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:54:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8f4f5f3d-cac9-4b21-931d-fc14aee117ae tempest-GroupSnapshotsV319Test-1815270957 None] Delete group completed successfully. Nov 05 10:54:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "cinder-dd30db1b-ee39-425c-b8d7-375a550e8e09-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "cinder-dd30db1b-ee39-425c-b8d7-375a550e8e09-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "cinder-quobyte-dd30db1b-ee39-425c-b8d7-375a550e8e09" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "cinder-quobyte-dd30db1b-ee39-425c-b8d7-375a550e8e09" acquired by "delete_volume" :: waited 0.081s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7280dc40-2196-4fa6-9033-55be3ec690ed]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:13 devstack sudo[90754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 Nov 05 10:54:13 devstack sudo[90754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:14 devstack sudo[90754]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09" returned: 0 in 1.117s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:14 devstack sudo[90794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09 Nov 05 10:54:14 devstack sudo[90794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:14 devstack sudo[90794]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd30db1b-ee39-425c-b8d7-375a550e8e09" returned: 0 in 0.654s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "cinder-quobyte-dd30db1b-ee39-425c-b8d7-375a550e8e09" released by "delete_volume" :: held 1.916s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Created reservations ['1a133390-ad55-44dd-b547-c5cb8d11a105', 'db928837-c10a-49c8-a46d-73cdefda6c39', 'a983f07c-4e84-4e27-9b3b-4cb36fb19e6e', '57ef828e-f3af-4a73-b0dc-c0131341afac'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:15 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:54:15 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:15 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.824s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:54:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Deleted volume successfully. Nov 05 10:54:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17a9447c-00ce-401a-a3a0-8dd694a89f83 tempest-DeleteServersTestJSON-1572819524 None] Lock "cinder-dd30db1b-ee39-425c-b8d7-375a550e8e09-delete_volume" released by "delete_volume" :: held 3.280s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Flow 'volume_create_manager' (13cb1ae4-51bb-4aec-b665-376f981f0dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0379d851-35f1-4a1f-80bb-7a8bf74e62bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0379d851-35f1-4a1f-80bb-7a8bf74e62bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-582842906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca4015-db34-4008-bfc6-5aab35bb943a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90d1a6d35149e38b51e5ef5d3ee33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:23Z,use_quota=True,user_id='94baeb16e1214e27826157dc49a3193a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dd6f7f-6ac0-42d1-96f5-bb700c39af0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60dd6f7f-6ac0-42d1-96f5-bb700c39af0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778aa8b6-7c44-44d8-b5e7-01091cdf4ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (778aa8b6-7c44-44d8-b5e7-01091cdf4ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32ca4015-db34-4008-bfc6-5aab35bb943a', 'volume_name': 'volume-32ca4015-db34-4008-bfc6-5aab35bb943a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbca36a0-4f02-43bc-9500-23929b48e501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbca36a0-4f02-43bc-9500-23929b48e501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdf1655-d7fa-4b67-9c58-528092704f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Volume 32ca4015-db34-4008-bfc6-5aab35bb943a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32ca4015-db34-4008-bfc6-5aab35bb943a', 'volume_size': 1} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-582842906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32ca4015-db34-4008-bfc6-5aab35bb943a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed90d1a6d35149e38b51e5ef5d3ee33e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:23Z,use_quota=True,user_id='94baeb16e1214e27826157dc49a3193a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Creating volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:54:23 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:54:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:23 devstack sudo[90815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a 1073741824 Nov 05 10:54:23 devstack sudo[90815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:24 devstack sudo[90815]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a 1073741824" returned: 0 in 0.686s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:24 devstack sudo[90822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a Nov 05 10:54:24 devstack sudo[90822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:24 devstack sudo[90822]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a" returned: 0 in 0.613s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.477s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fdf1655-d7fa-4b67-9c58-528092704f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32ca4015-db34-4008-bfc6-5aab35bb943a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6929d048-d5f3-44a1-a169-a31ed294b545) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Volume volume-32ca4015-db34-4008-bfc6-5aab35bb943a (32ca4015-db34-4008-bfc6-5aab35bb943a): created successfully Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6929d048-d5f3-44a1-a169-a31ed294b545) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Flow 'volume_create_manager' (13cb1ae4-51bb-4aec-b665-376f981f0dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a8370181-a2b4-4256-8733-d351a2bf88f0 tempest-SnapshotsActionsTest-1798670753 None] Created volume successfully. Nov 05 10:54:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Creating offline snapshot 97c52e5b-5606-414d-badd-c0ce7d9101cc of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:54:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ac6f97-13d3-4cd2-9a7d-c1d83412c131]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:26 devstack sudo[90829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a Nov 05 10:54:26 devstack sudo[90829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:26 devstack sudo[90829]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a" returned: 0 in 0.630s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:26 devstack sudo[90835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc 1G Nov 05 10:54:26 devstack sudo[90835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:27 devstack sudo[90835]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc 1G" returned: 0 in 0.470s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:27 devstack sudo[90842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:27 devstack sudo[90842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:27 devstack sudo[90842]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.328s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:27 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc is being set with open permissions: ugo+rw Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:27 devstack sudo[90847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:27 devstack sudo[90847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:27 devstack sudo[90847]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:27 devstack sudo[90850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info Nov 05 10:54:27 devstack sudo[90850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:27 devstack sudo[90850]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info" returned: 0 in 0.285s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:27 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info is being set with open permissions: ugo+rw Nov 05 10:54:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:27 devstack sudo[90853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info Nov 05 10:54:27 devstack sudo[90853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:28 devstack sudo[90853]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.info" returned: 0 in 0.341s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-40938f3f-a983-48b3-b0f9-6d95968f0b5c tempest-SnapshotsActionsTest-1798670753 None] Create snapshot completed successfully Nov 05 10:54:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Creating offline snapshot a6f4aa53-dc1f-4f06-9c30-5aa23328d1df of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:54:29 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffc3430-323c-469d-a933-6c8440c78e45]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:29 devstack sudo[90856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:29 devstack sudo[90856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:30 devstack sudo[90856]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:30 devstack sudo[90885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df 1G Nov 05 10:54:30 devstack sudo[90885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:30 devstack sudo[90885]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df 1G" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:31 devstack sudo[90891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df Nov 05 10:54:31 devstack sudo[90891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:31 devstack sudo[90891]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" returned: 0 in 0.357s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:31 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df is being set with open permissions: ugo+rw Nov 05 10:54:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:31 devstack sudo[90896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df Nov 05 10:54:31 devstack sudo[90896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:31 devstack sudo[90896]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" returned: 0 in 0.283s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86d36d8c-0170-4ee9-b6f4-4206fb0e15dd tempest-SnapshotsActionsTest-1798670753 None] Create snapshot completed successfully Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Deleting offline snapshot a6f4aa53-dc1f-4f06-9c30-5aa23328d1df of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] snapshot_file for this snap is: volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[204b545e-2868-476c-9bda-48d329a14d04]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:32 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df Nov 05 10:54:32 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:32 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" returned: 0 in 0.408s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[067e9e64-bf33-4513-8fe3-f0d76a8b60fc]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:32 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:32 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:33 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:33 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df Nov 05 10:54:33 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:33 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" returned: 0 in 0.551s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:33 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df Nov 05 10:54:33 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:33 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" returned: 0 in 0.371s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df" released by "_delete_snapshot" :: held 1.897s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_snapshot" :: held 1.928s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:34 devstack cinder-volume[87369]: WARNING cinder.quota [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:54:34 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Created reservations ['60b5811b-fab7-4eb1-8144-9410b53803ac', 'c5d06069-c872-4a45-8761-cd4248caa29a', 'b86ef653-a402-4ddf-be73-8060da7fd4a9', 'a8cddabb-a6c1-4d04-bca7-e305e52997ee'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Delete snapshot completed successfully. Nov 05 10:54:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-574fbc05-91cb-4bb8-9e36-808cad635fdc tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-a6f4aa53-dc1f-4f06-9c30-5aa23328d1df-delete_snapshot" released by "delete_snapshot" :: held 2.198s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Creating offline snapshot 40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:54:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ea312fb-c1c7-4ddd-aafc-0a46aad140fc]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:35 devstack sudo[90919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:35 devstack sudo[90919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:36 devstack sudo[90919]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.441s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:36 devstack sudo[90924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 1G Nov 05 10:54:36 devstack sudo[90924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:36 devstack sudo[90924]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 1G" returned: 0 in 0.546s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:36 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 Nov 05 10:54:36 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:37 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" returned: 0 in 0.356s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:37 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 is being set with open permissions: ugo+rw Nov 05 10:54:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:37 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 Nov 05 10:54:37 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:37 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.808s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bcbe4cc9-7f93-4ca4-a5aa-8a81b8773e65 tempest-SnapshotsActionsTest-1798670753 None] Create snapshot completed successfully Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Deleting offline snapshot 40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] snapshot_file for this snap is: volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ee3fa0-2199-450d-bbb9-62c09a471e6b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:38 devstack sudo[90941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 Nov 05 10:54:38 devstack sudo[90941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:38 devstack sudo[90941]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" returned: 0 in 0.439s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7b35a3-a214-4c7b-a346-3d601c4cd293]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:38 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:38 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:39 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:39 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 Nov 05 10:54:39 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:39 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:39 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922 Nov 05 10:54:39 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:39 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" returned: 0 in 0.346s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922" released by "_delete_snapshot" :: held 1.921s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_snapshot" :: held 1.958s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Created reservations ['10a786c4-339f-4406-abc9-13c27975c238', '80c6deb0-2490-43dc-9a06-6def14bd106b', 'f4926921-3396-4061-97f8-da50d6c23920', 'a624779e-7098-4bf5-84e6-db9e6fbfe1d5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Delete snapshot completed successfully. Nov 05 10:54:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-91dc5d46-cf30-490c-956c-fdb74be69e27 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-40a2e4ba-c53b-4e70-96c8-4bd4b65b3922-delete_snapshot" released by "delete_snapshot" :: held 2.220s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Creating offline snapshot 902cb7f0-b8a0-4786-aeb7-13e8806a7a48 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:54:41 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d2cec28-41e7-4d95-befa-413d9da384b8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:42 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:42 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Flow 'volume_create_manager' (9829c85e-8edb-474e-bcaa-b85023ecbe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7152bcac-aa76-4745-8380-a0897f97871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7152bcac-aa76-4745-8380-a0897f97871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-836602491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6812d2-93de-4e3d-b05b-61b5068b713e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923d72b844094b9a8731d94d83d8fc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:42Z,use_quota=True,user_id='3e4003a2cc6345a9bf267d7637044681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fa94e8-301d-4ca4-ad06-0ef4e4cc424a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29fa94e8-301d-4ca4-ad06-0ef4e4cc424a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8669cb91-695f-4efc-81e1-ba4cd2261254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8669cb91-695f-4efc-81e1-ba4cd2261254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b6812d2-93de-4e3d-b05b-61b5068b713e', 'volume_name': 'volume-6b6812d2-93de-4e3d-b05b-61b5068b713e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bbe406-493b-4817-bb94-9512aea8d631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6bbe406-493b-4817-bb94-9512aea8d631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddb2cd0-b3fc-456d-a75c-0b3a84768987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Volume 6b6812d2-93de-4e3d-b05b-61b5068b713e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b6812d2-93de-4e3d-b05b-61b5068b713e', 'volume_size': 1} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:42 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.454s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:42 devstack sudo[90968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 1G Nov 05 10:54:42 devstack sudo[90968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:42 devstack sudo[90968]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 1G" returned: 0 in 0.568s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:42 devstack sudo[90974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 Nov 05 10:54:42 devstack sudo[90974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:43 devstack sudo[90974]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:43 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 is being set with open permissions: ugo+rw Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:43 devstack sudo[90979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 Nov 05 10:54:43 devstack sudo[90979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:43 devstack sudo[90979]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48" returned: 0 in 0.270s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.406s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-836602491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b6812d2-93de-4e3d-b05b-61b5068b713e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923d72b844094b9a8731d94d83d8fc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:42Z,use_quota=True,user_id='3e4003a2cc6345a9bf267d7637044681',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Creating volume 6b6812d2-93de-4e3d-b05b-61b5068b713e {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:54:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:54:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:43 devstack sudo[90982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e 1073741824 Nov 05 10:54:43 devstack sudo[90982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8b3ef789-f49f-45a0-a577-e34a02969019 tempest-SnapshotsActionsTest-1798670753 None] Create snapshot completed successfully Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-902cb7f0-b8a0-4786-aeb7-13e8806a7a48-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-902cb7f0-b8a0-4786-aeb7-13e8806a7a48-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-902cb7f0-b8a0-4786-aeb7-13e8806a7a48" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-902cb7f0-b8a0-4786-aeb7-13e8806a7a48" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Deleting offline snapshot 902cb7f0-b8a0-4786-aeb7-13e8806a7a48 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] snapshot_file for this snap is: volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7b644-d8d8-4f65-aaff-0359def981ba]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:44 devstack sudo[90982]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e 1073741824" returned: 0 in 0.584s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:44 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 Nov 05 10:54:44 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:44 devstack sudo[90989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e Nov 05 10:54:44 devstack sudo[90989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:44 devstack sudo[90989]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e" returned: 0 in 0.293s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] <== create_volume: return (941ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.945s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:44 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ddb2cd0-b3fc-456d-a75c-0b3a84768987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b6812d2-93de-4e3d-b05b-61b5068b713e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f647d41-f7ea-47ff-848a-ca3fb0a5aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48" returned: 0 in 0.427s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Volume volume-6b6812d2-93de-4e3d-b05b-61b5068b713e (6b6812d2-93de-4e3d-b05b-61b5068b713e): created successfully Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f647d41-f7ea-47ff-848a-ca3fb0a5aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Flow 'volume_create_manager' (9829c85e-8edb-474e-bcaa-b85023ecbe65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[70f3db49-7981-468b-9cd0-39edf2b0a170]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c962895b-17f9-4882-9d00-680df34411d9 tempest-AttachVolumeShelveTestJSON-1467638209 None] Created volume successfully. Nov 05 10:54:44 devstack sudo[90996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:44 devstack sudo[90996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:45 devstack sudo[90996]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.607s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:45 devstack sudo[91005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 Nov 05 10:54:45 devstack sudo[91005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:45 devstack sudo[91005]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48" returned: 0 in 0.528s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:45 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48 Nov 05 10:54:45 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:46 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.902cb7f0-b8a0-4786-aeb7-13e8806a7a48" returned: 0 in 0.431s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-902cb7f0-b8a0-4786-aeb7-13e8806a7a48" released by "_delete_snapshot" :: held 2.184s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_snapshot" :: held 2.221s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=66,cinder:UPDATE=52,cinder:INSERT=14,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=64,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Created reservations ['aea30c20-2e58-460f-88b0-4f6659685459', 'a72825d4-e51a-400f-aa8e-40721b2fa74b', 'af6bf7c7-5131-4cc6-bc58-32d047a8adf7', '2918a7cf-ff89-4917-9661-2e85ed20b502'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Delete snapshot completed successfully. Nov 05 10:54:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-da77455c-ca73-45df-a7da-fe9bee26eec5 tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-902cb7f0-b8a0-4786-aeb7-13e8806a7a48-delete_snapshot" released by "delete_snapshot" :: held 2.530s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Creating offline snapshot 0b07bb99-abad-436e-8f1b-83c60e0eafa5 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:54:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c89fc1d-409d-4457-83bf-f4dd87f41dde]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:48 devstack sudo[91033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:48 devstack sudo[91033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:48 devstack sudo[91033]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.672s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:48 devstack sudo[91038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 1G Nov 05 10:54:48 devstack sudo[91038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:49 devstack sudo[91038]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 1G" returned: 0 in 0.825s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:49 devstack sudo[91047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 Nov 05 10:54:49 devstack sudo[91047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:50 devstack sudo[91067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:54:50 devstack sudo[91067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:50 devstack sudo[91047]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5" returned: 0 in 0.819s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:50 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 is being set with open permissions: ugo+rw Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:50 devstack sudo[91071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 Nov 05 10:54:50 devstack sudo[91071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:50 devstack sudo[91071]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:50 devstack sudo[91067]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.954s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.599s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:54:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3a47c818-50b5-4d6d-9e5d-70125e99d4a0 tempest-SnapshotsActionsTest-1798670753 None] Create snapshot completed successfully Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-0b07bb99-abad-436e-8f1b-83c60e0eafa5-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-0b07bb99-abad-436e-8f1b-83c60e0eafa5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Acquiring lock "cinder-quobyte-0b07bb99-abad-436e-8f1b-83c60e0eafa5" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-0b07bb99-abad-436e-8f1b-83c60e0eafa5" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Deleting offline snapshot 0b07bb99-abad-436e-8f1b-83c60e0eafa5 of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] snapshot_file for this snap is: volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32a8291-ac51-446e-9cfa-eecb689ce363]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:51 devstack sudo[91080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 Nov 05 10:54:51 devstack sudo[91080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:52 devstack sudo[91080]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5" returned: 0 in 0.757s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c88268-1249-4db9-acb8-407e819221d4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:52 devstack sudo[91086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:52 devstack sudo[91086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:53 devstack sudo[91086]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.711s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:53 devstack sudo[91091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 Nov 05 10:54:53 devstack sudo[91091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:53 devstack sudo[91091]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5" returned: 0 in 0.633s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:53 devstack sudo[91096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5 Nov 05 10:54:53 devstack sudo[91096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:54 devstack sudo[91096]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.0b07bb99-abad-436e-8f1b-83c60e0eafa5" returned: 0 in 0.505s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-0b07bb99-abad-436e-8f1b-83c60e0eafa5" released by "_delete_snapshot" :: held 2.815s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_snapshot" :: held 2.877s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:54 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Created reservations ['2a9362ee-24e1-4c72-9e65-6e7732cb3231', '5eab2972-8235-4175-a8b3-b322cbfb3c6e', '80914cd3-aa7b-4385-aeaf-2c781fedc603', 'a40824c6-a511-45e7-8c52-b2b1e3fd454d'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Delete snapshot completed successfully. Nov 05 10:54:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c7abf84-7ea9-4ba0-850f-ff780ec3dd0b tempest-SnapshotsActionsTest-2017028509 None] Lock "cinder-0b07bb99-abad-436e-8f1b-83c60e0eafa5-delete_snapshot" released by "delete_snapshot" :: held 3.115s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "cinder-97c52e5b-5606-414d-badd-c0ce7d9101cc-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-97c52e5b-5606-414d-badd-c0ce7d9101cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "cinder-quobyte-97c52e5b-5606-414d-badd-c0ce7d9101cc" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-97c52e5b-5606-414d-badd-c0ce7d9101cc" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Deleting offline snapshot 97c52e5b-5606-414d-badd-c0ce7d9101cc of volume 32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] snapshot_file for this snap is: volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0839bc-d4a8-4728-a7c2-0c92238a767e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:56 devstack sudo[91104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:56 devstack sudo[91104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:56 devstack sudo[91104]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.587s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32ca4015-db34-4008-bfc6-5aab35bb943a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:54:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62514289-ef2d-47d1-a168-c9305f4c157f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:56 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a Nov 05 10:54:56 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:57 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a" returned: 0 in 0.623s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:57 devstack sudo[91126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:57 devstack sudo[91126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:57 devstack sudo[91126]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.835s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:58 devstack sudo[91143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc Nov 05 10:54:58 devstack sudo[91143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Flow 'volume_create_manager' (d4f2fa1f-1bb0-499b-a748-b603237f5377) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87539a9c-9f54-4d73-90c1-3da03bb8a434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87539a9c-9f54-4d73-90c1-3da03bb8a434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1660892560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5b53b7-0d5d-42a4-ae37-e877603165cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f1eb7a1cc243dcb64500946eb83689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:58Z,use_quota=True,user_id='5775e5fc65c7452593dab81dfcf0cad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f1f6c1-14b5-4b3b-be84-7e786d2b4a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84f1f6c1-14b5-4b3b-be84-7e786d2b4a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0d8a0a-ba01-439c-9fa9-588f6dbddd66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f0d8a0a-ba01-439c-9fa9-588f6dbddd66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db5b53b7-0d5d-42a4-ae37-e877603165cf', 'volume_name': 'volume-db5b53b7-0d5d-42a4-ae37-e877603165cf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a3d2a-5b3a-44f7-ad00-d1a29cb0aa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (969a3d2a-5b3a-44f7-ad00-d1a29cb0aa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a838204d-f08f-499b-a6eb-912d731f03d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Volume db5b53b7-0d5d-42a4-ae37-e877603165cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db5b53b7-0d5d-42a4-ae37-e877603165cf', 'volume_size': 1} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:54:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1660892560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db5b53b7-0d5d-42a4-ae37-e877603165cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b4f1eb7a1cc243dcb64500946eb83689',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:54:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:54:58Z,use_quota=True,user_id='5775e5fc65c7452593dab81dfcf0cad6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Creating volume db5b53b7-0d5d-42a4-ae37-e877603165cf {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:54:58 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:58 devstack sudo[91145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf 1073741824 Nov 05 10:54:58 devstack sudo[91145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:58 devstack sudo[91143]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a.97c52e5b-5606-414d-badd-c0ce7d9101cc" returned: 0 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-97c52e5b-5606-414d-badd-c0ce7d9101cc" released by "_delete_snapshot" :: held 2.590s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_snapshot" :: held 2.628s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Created reservations ['aa3b8cc0-1e5a-492b-80c9-a7c210e01c96', 'a7b5b120-d449-4389-9e74-fd04250beff7', '8ee5a3a3-9f88-4912-b3f1-3097ccc554b5', 'c464cc34-3886-49e1-acee-88f3d5edc6c8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:54:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Delete snapshot completed successfully. Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a59f91c0-e4cb-4224-b155-8ebbfd3e3e4e tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-97c52e5b-5606-414d-badd-c0ce7d9101cc-delete_snapshot" released by "delete_snapshot" :: held 2.871s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:54:58 devstack sudo[91145]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf 1073741824" returned: 0 in 0.641s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:59 devstack sudo[91151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf Nov 05 10:54:59 devstack sudo[91151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "cinder-32ca4015-db34-4008-bfc6-5aab35bb943a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-32ca4015-db34-4008-bfc6-5aab35bb943a-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" acquired by "delete_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:54:59 devstack sudo[91151]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf" returned: 0 in 0.466s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] <== create_volume: return (1168ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.172s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a838204d-f08f-499b-a6eb-912d731f03d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db5b53b7-0d5d-42a4-ae37-e877603165cf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eccaa79-3ce0-415c-80fb-32de0bbe8d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0445885c-202e-4dc0-b977-5866a4ffb742]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Volume volume-db5b53b7-0d5d-42a4-ae37-e877603165cf (db5b53b7-0d5d-42a4-ae37-e877603165cf): created successfully Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eccaa79-3ce0-415c-80fb-32de0bbe8d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Flow 'volume_create_manager' (d4f2fa1f-1bb0-499b-a748-b603237f5377) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:54:59 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2fb8f163-d82b-4ba3-b008-b7f5adccbf28 tempest-TaggedAttachmentsTest-3784208 None] Created volume successfully. Nov 05 10:54:59 devstack sudo[91154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a Nov 05 10:54:59 devstack sudo[91154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:59 devstack sudo[91154]: pam_unix(sudo:session): session closed for user root Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a" returned: 0 in 0.455s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:54:59 devstack sudo[91160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a Nov 05 10:54:59 devstack sudo[91160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ca0a28f0-1e98-4d31-8fbc-3d8c915e038b req-6fec449e-1745-48ed-ba36-841c61db2765 tempest-AttachVolumeShelveTestJSON-1467638209 None] No connector for attachment ebdabc0c-c833-4afa-9a75-a422b54847e6; skipping storage backend terminate_connection call. {{(pid=87369) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5009}} Nov 05 10:54:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ca0a28f0-1e98-4d31-8fbc-3d8c915e038b req-6fec449e-1745-48ed-ba36-841c61db2765 tempest-AttachVolumeShelveTestJSON-1467638209 None] Deleting attachment ebdabc0c-c833-4afa-9a75-a422b54847e6. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:55:00 devstack sudo[91160]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-32ca4015-db34-4008-bfc6-5aab35bb943a" returned: 0 in 0.359s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-quobyte-32ca4015-db34-4008-bfc6-5aab35bb943a" released by "delete_volume" :: held 0.939s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Created reservations ['d56f8f18-c218-40aa-9432-a1fa8c2fd7a7', '6ab0f1c3-4ec9-42e0-90e6-6928ab38d5af', '6723f0b4-968c-4caf-af27-d1d94345ef00', '3c5cd9db-f6bf-45f1-8133-01f51ece7f12'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:00 devstack sudo[91163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:55:00 devstack sudo[91163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:00 devstack sudo[91163]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:55:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Deleted volume successfully. Nov 05 10:55:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47a64d0e-6399-4c7e-be79-f1560dd382a5 tempest-SnapshotsActionsTest-1798670753 None] Lock "cinder-32ca4015-db34-4008-bfc6-5aab35bb943a-delete_volume" released by "delete_volume" :: held 1.574s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:55:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=28,cinder:INSERT=10,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:55:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=28,cinder:SELECT=20,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:55:25 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:55:25 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (8a5c3a95-4579-49cd-80da-d7f4682158db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a950ad9c-629d-440d-86b6-031e82a431f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a950ad9c-629d-440d-86b6-031e82a431f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-272603440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:55:46Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65820c23-8c89-4ae8-b75c-6f2282c2d3ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65820c23-8c89-4ae8-b75c-6f2282c2d3ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286492d3-b3aa-4fee-9f9c-2f9b69deab9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (286492d3-b3aa-4fee-9f9c-2f9b69deab9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e', 'volume_name': 'volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d176ae-f037-44e2-9c25-f76e04a018a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d176ae-f037-44e2-9c25-f76e04a018a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f103de5c-fa24-475f-80b3-6770a6eb0343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Volume fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e', 'volume_size': 1} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:55:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-272603440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:55:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:55:46Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Creating volume fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:55:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:55:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:45 devstack sudo[91986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e 1073741824 Nov 05 10:55:45 devstack sudo[91986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:46 devstack sudo[91986]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e 1073741824" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:46 devstack sudo[91993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e Nov 05 10:55:46 devstack sudo[91993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:46 devstack sudo[91993]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.950s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f103de5c-fa24-475f-80b3-6770a6eb0343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d192745-c54a-482a-b7c5-fa6a9392d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Volume volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e (fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e): created successfully Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d192745-c54a-482a-b7c5-fa6a9392d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (8a5c3a95-4579-49cd-80da-d7f4682158db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:55:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fce95ccc-91ca-4ac2-b812-6b4c45f4a997 tempest-AttachVolumeTestJSON-1751119558 None] Created volume successfully. Nov 05 10:55:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1f8ea31e-f95d-496e-a4cb-ecb29372d1b1 req-5dc3426c-da6a-4b26-9292-5482743699f5 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1f8ea31e-f95d-496e-a4cb-ecb29372d1b1 req-5dc3426c-da6a-4b26-9292-5482743699f5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1f8ea31e-f95d-496e-a4cb-ecb29372d1b1 req-5dc3426c-da6a-4b26-9292-5482743699f5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-1f8ea31e-f95d-496e-a4cb-ecb29372d1b1 req-5dc3426c-da6a-4b26-9292-5482743699f5 tempest-AttachVolumeTestJSON-1751119558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '186dc68f-7634-4831-a6f0-d0d72f0ff77e', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:55:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-1f8ea31e-f95d-496e-a4cb-ecb29372d1b1 req-5dc3426c-da6a-4b26-9292-5482743699f5 tempest-AttachVolumeTestJSON-1751119558 None] attachment_update completed successfully. Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:50 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:55:50 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:50 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 9 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:55:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (d29dd188-ff7c-4245-9a19-99e97fe569cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0bfa71-6751-4d5b-a468-019de66d1353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f0bfa71-6751-4d5b-a468-019de66d1353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-890209688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb1498d-c628-40c4-bb9d-b3c49c2b51f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:55:53Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5683c96b-5c7b-4dac-b5fe-c424ffad9300) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5683c96b-5c7b-4dac-b5fe-c424ffad9300) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068cadc9-d4b7-4392-a50c-9f80ed4d5c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (068cadc9-d4b7-4392-a50c-9f80ed4d5c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb1498d-c628-40c4-bb9d-b3c49c2b51f9', 'volume_name': 'volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb801745-934d-48ab-ac55-6cd9821a7ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb801745-934d-48ab-ac55-6cd9821a7ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987e8370-95c3-4987-864b-13ad8d3835f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Volume edb1498d-c628-40c4-bb9d-b3c49c2b51f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9', 'volume_size': 1} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:55:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-890209688',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb1498d-c628-40c4-bb9d-b3c49c2b51f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d410b6ada60f4a0da082e26cd88fe39c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:55:53Z,use_quota=True,user_id='801ba78311bb48bbbe12dc09752cb0ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Creating volume edb1498d-c628-40c4-bb9d-b3c49c2b51f9 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:55:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:52 devstack sudo[92493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 1073741824 Nov 05 10:55:52 devstack sudo[92493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-91c18fa3-09b1-45cc-bfef-518bb6947078 req-8507fa52-3006-4d36-a79b-ffae33647f34 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:53 devstack sudo[92493]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 1073741824" returned: 0 in 0.535s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:55:53 devstack sudo[92500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 Nov 05 10:55:53 devstack sudo[92500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:55:53 devstack sudo[92500]: pam_unix(sudo:session): session closed for user root Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-91c18fa3-09b1-45cc-bfef-518bb6947078 req-8507fa52-3006-4d36-a79b-ffae33647f34 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.730s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-91c18fa3-09b1-45cc-bfef-518bb6947078 req-8507fa52-3006-4d36-a79b-ffae33647f34 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (987e8370-95c3-4987-864b-13ad8d3835f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bf44ef-f7c6-4083-bb8a-2a7b58312764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:55:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Volume volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 (edb1498d-c628-40c4-bb9d-b3c49c2b51f9): created successfully Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66bf44ef-f7c6-4083-bb8a-2a7b58312764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Flow 'volume_create_manager' (d29dd188-ff7c-4245-9a19-99e97fe569cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:55:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-91c18fa3-09b1-45cc-bfef-518bb6947078 req-8507fa52-3006-4d36-a79b-ffae33647f34 tempest-TaggedAttachmentsTest-3784208 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-db5b53b7-0d5d-42a4-ae37-e877603165cf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '33bde67e-ebfe-4b51-9ccf-d94d7b0e759a', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:55:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-dfe0a7b6-52e5-4109-a487-36e89d3446d5 tempest-AttachVolumeTestJSON-1751119558 None] Created volume successfully. Nov 05 10:55:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-91c18fa3-09b1-45cc-bfef-518bb6947078 req-8507fa52-3006-4d36-a79b-ffae33647f34 tempest-TaggedAttachmentsTest-3784208 None] attachment_update completed successfully. Nov 05 10:55:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-f9c74449-3e8a-4a52-8532-8c4e38c32c53 req-a2e7efeb-bf29-408d-8672-12b0915c662c tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:55:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-f9c74449-3e8a-4a52-8532-8c4e38c32c53 req-a2e7efeb-bf29-408d-8672-12b0915c662c tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:55:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-f9c74449-3e8a-4a52-8532-8c4e38c32c53 req-a2e7efeb-bf29-408d-8672-12b0915c662c tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:55:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-f9c74449-3e8a-4a52-8532-8c4e38c32c53 req-a2e7efeb-bf29-408d-8672-12b0915c662c tempest-AttachVolumeTestJSON-1751119558 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7c09793-3fed-4463-9679-e1104014a71e', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:55:55 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-f9c74449-3e8a-4a52-8532-8c4e38c32c53 req-a2e7efeb-bf29-408d-8672-12b0915c662c tempest-AttachVolumeTestJSON-1751119558 None] attachment_update completed successfully. Nov 05 10:55:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-a1d0c1dd-8868-45ce-8e3d-190953a9f6e2 req-4c1a0343-7a9f-47fa-a283-0cc1f719b998 tempest-TaggedAttachmentsTest-3784208 None] Terminate volume connection completed successfully. Nov 05 10:55:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-a1d0c1dd-8868-45ce-8e3d-190953a9f6e2 req-4c1a0343-7a9f-47fa-a283-0cc1f719b998 tempest-TaggedAttachmentsTest-3784208 None] Deleting attachment 33bde67e-ebfe-4b51-9ccf-d94d7b0e759a. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:55:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-f988f9aa-3b49-4f44-b632-0bcf9d5813d5 req-d9cdd372-cc83-4e1d-b1ae-4c1d94cdb86b tempest-AttachVolumeTestJSON-1751119558 None] Terminate volume connection completed successfully. Nov 05 10:55:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-f988f9aa-3b49-4f44-b632-0bcf9d5813d5 req-d9cdd372-cc83-4e1d-b1ae-4c1d94cdb86b tempest-AttachVolumeTestJSON-1751119558 None] Deleting attachment 186dc68f-7634-4831-a6f0-d0d72f0ff77e. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:56:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-aa1251fe-d4b0-482c-8bd9-b6b39fe7c5e2 req-6af6561f-58de-4277-8eb9-bc59439935b1 tempest-AttachVolumeTestJSON-1751119558 None] Terminate volume connection completed successfully. Nov 05 10:56:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-aa1251fe-d4b0-482c-8bd9-b6b39fe7c5e2 req-6af6561f-58de-4277-8eb9-bc59439935b1 tempest-AttachVolumeTestJSON-1751119558 None] Deleting attachment f7c09793-3fed-4463-9679-e1104014a71e. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=26,cinder:UPDATE=12,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=27,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-edb1498d-c628-40c4-bb9d-b3c49c2b51f9-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-edb1498d-c628-40c4-bb9d-b3c49c2b51f9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-quobyte-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b1169cb-3be9-4ae6-85c4-c856b5eed6db]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:10 devstack sudo[92665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 Nov 05 10:56:10 devstack sudo[92665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:11 devstack sudo[92665]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:11 devstack sudo[92670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9 Nov 05 10:56:11 devstack sudo[92670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:11 devstack sudo[92670]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-edb1498d-c628-40c4-bb9d-b3c49c2b51f9" released by "delete_volume" :: held 0.849s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Created reservations ['b920b6c8-4970-4593-a8d8-62d8fa08a732', '50b723f1-d2ba-430a-ab02-eab9b654dd8c', '433002b6-e3f7-486c-aac8-ee7001852526', 'caf09d90-c90a-492d-8f58-fd1fa5a4ad46'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:11 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:11 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-quobyte-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "cinder-db5b53b7-0d5d-42a4-ae37-e877603165cf-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" acquired by "delete_volume" :: waited 0.054s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb27408d-99e9-4170-9523-75e227457233]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "cinder-db5b53b7-0d5d-42a4-ae37-e877603165cf-delete_volume" acquired by "delete_volume" :: waited 0.133s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:12 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.599s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "cinder-quobyte-db5b53b7-0d5d-42a4-ae37-e877603165cf" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Deleted volume successfully. Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "cinder-quobyte-db5b53b7-0d5d-42a4-ae37-e877603165cf" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:12 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9baf31c0-6213-4262-8ac1-899fd7498c64 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-edb1498d-c628-40c4-bb9d-b3c49c2b51f9-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:12 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b0b4b9-df1f-4387-94fb-fca6bbb65c5c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:12 devstack sudo[92713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf Nov 05 10:56:12 devstack sudo[92713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:12 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" returned: 0 in 0.550s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:12 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e Nov 05 10:56:12 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Acquiring lock "cinder-6b6812d2-93de-4e3d-b05b-61b5068b713e-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "cinder-6b6812d2-93de-4e3d-b05b-61b5068b713e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Acquiring lock "cinder-quobyte-6b6812d2-93de-4e3d-b05b-61b5068b713e" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "cinder-quobyte-6b6812d2-93de-4e3d-b05b-61b5068b713e" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[810227c6-bb3b-45dd-94c3-662e68920d2a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:13 devstack sudo[92713]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf" returned: 0 in 0.717s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:13 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf Nov 05 10:56:13 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:13 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e Nov 05 10:56:13 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:13 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" returned: 0 in 0.506s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e" released by "delete_volume" :: held 1.179s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Created reservations ['13f07ca3-ab36-4d7f-821a-da47a6a568f0', 'a429e7c7-af3d-4ada-9c5e-9a8be921350a', '39b810a1-a725-4ce1-a405-870536260d44', '8bfd470a-85da-4ebe-b7cf-28aeb888daa6'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:13 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db5b53b7-0d5d-42a4-ae37-e877603165cf" returned: 0 in 0.394s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "cinder-quobyte-db5b53b7-0d5d-42a4-ae37-e877603165cf" released by "delete_volume" :: held 1.195s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:13 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e" returned: 0 in 0.629s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:13 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:13 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:13 devstack sudo[92739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e Nov 05 10:56:13 devstack sudo[92739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Created reservations ['61fecab6-5533-4149-ab2f-fa0e6f82738c', '93d3a669-088d-4d7b-ac4d-131cc6a264bf', '26505745-ebbb-40bd-bdc2-9feeb25d532e', '678d4c84-c0a6-483d-8037-957dece7402a'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:13 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:13 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:14 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.407s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Deleted volume successfully. Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d03c8eb-a00e-473c-ae02-1cbf3cc5fab8 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-fd1cfd9f-0693-4ad2-9d5d-64b91ffb506e-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:14 devstack sudo[92739]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6b6812d2-93de-4e3d-b05b-61b5068b713e" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "cinder-quobyte-6b6812d2-93de-4e3d-b05b-61b5068b713e" released by "delete_volume" :: held 1.173s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Created reservations ['22d906df-f3ee-4005-94ea-c921b17f1116', '721b93e6-cf03-4358-97ef-a49c7b201b2e', 'b9e4690a-b5b1-43fa-b050-5de1997fea77', '11dcd866-b5e9-43b3-993c-d60f803ba509'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:14 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.469s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Deleted volume successfully. Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8c21df14-77fb-4c92-9ad9-cbb8352d5f10 tempest-TaggedAttachmentsTest-3784208 None] Lock "cinder-db5b53b7-0d5d-42a4-ae37-e877603165cf-delete_volume" released by "delete_volume" :: held 2.172s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:14 devstack sudo[92746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:14 devstack sudo[92746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-1dd7f6a2-0ea5-4d36-b09d-5c936952c804-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-1dd7f6a2-0ea5-4d36-b09d-5c936952c804-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "cinder-quobyte-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7c96da-597f-42e4-bcc0-305118d8af7e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:14 devstack sudo[92746]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.360s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Deleted volume successfully. Nov 05 10:56:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b7ba2d6-b652-464d-9fe1-23331f5714ab tempest-AttachVolumeShelveTestJSON-1467638209 None] Lock "cinder-6b6812d2-93de-4e3d-b05b-61b5068b713e-delete_volume" released by "delete_volume" :: held 1.904s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:14 devstack sudo[92748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 Nov 05 10:56:14 devstack sudo[92748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:15 devstack sudo[92748]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:15 devstack sudo[92754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804 Nov 05 10:56:15 devstack sudo[92754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:15 devstack sudo[92754]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" returned: 0 in 0.353s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-quobyte-1dd7f6a2-0ea5-4d36-b09d-5c936952c804" released by "delete_volume" :: held 0.895s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Created reservations ['f3122c8a-950e-4510-9d45-9bf7c349148c', '28e90c6d-7b77-4b5a-913b-daa90609831b', '3ec322bd-914d-434c-ab2c-c13d05142843', 'f3e4f06a-36d7-4c9a-916c-45912f749893'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:15 devstack sudo[92757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:15 devstack sudo[92757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:16 devstack sudo[92757]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:16 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Deleted volume successfully. Nov 05 10:56:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-25798f0b-2bc9-4f0b-9e52-6b7d39fdf980 tempest-AttachVolumeTestJSON-1751119558 None] Lock "cinder-1dd7f6a2-0ea5-4d36-b09d-5c936952c804-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:25 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=24,cinder:UPDATE=41,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:26 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=26,cinder:INSERT=12,cinder:UPDATE=39,cinder:DELETE=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Flow 'volume_create_manager' (48de5bd6-dc02-4a11-b6dc-c8539ab5e41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02517a1-8d93-4989-ac61-f9e8177fd8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a02517a1-8d93-4989-ac61-f9e8177fd8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-42310837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1b4f7b-2fba-4603-a2f9-987282885a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c729002dd5d44fdab6cc7aeb2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:32Z,use_quota=True,user_id='d5a5236c9efc4192b8313902da822004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cdbae7-e1bb-42bf-a7a9-574617c1fc09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91cdbae7-e1bb-42bf-a7a9-574617c1fc09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad8117b-c865-4922-92c4-01c8361d2622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cad8117b-c865-4922-92c4-01c8361d2622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f1b4f7b-2fba-4603-a2f9-987282885a36', 'volume_name': 'volume-6f1b4f7b-2fba-4603-a2f9-987282885a36', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebe53c5-1055-4f68-99cb-057564cd16a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ebe53c5-1055-4f68-99cb-057564cd16a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeea01e-1910-4c65-b41c-aff45af62c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:31 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Volume 6f1b4f7b-2fba-4603-a2f9-987282885a36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f1b4f7b-2fba-4603-a2f9-987282885a36', 'volume_size': 1} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-42310837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f1b4f7b-2fba-4603-a2f9-987282885a36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c729002dd5d44fdab6cc7aeb2ccde16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:32Z,use_quota=True,user_id='d5a5236c9efc4192b8313902da822004',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Creating volume 6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:56:31 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:56:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:31 devstack sudo[92789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 1073741824 Nov 05 10:56:31 devstack sudo[92789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:32 devstack sudo[92789]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 1073741824" returned: 0 in 0.586s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:32 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 Nov 05 10:56:32 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:32 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36" returned: 0 in 0.258s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.907s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7eeea01e-1910-4c65-b41c-aff45af62c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f1b4f7b-2fba-4603-a2f9-987282885a36', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cca433-25b2-498c-b4af-f581c790ef7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:32 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Volume volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 (6f1b4f7b-2fba-4603-a2f9-987282885a36): created successfully Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (53cca433-25b2-498c-b4af-f581c790ef7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Flow 'volume_create_manager' (48de5bd6-dc02-4a11-b6dc-c8539ab5e41f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-ef390082-c438-45a2-adc2-210c80cedc71 req-f68cdc54-1772-438c-ad2b-cf0064f092a9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Created volume successfully. Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Creating offline snapshot 7ca61eeb-4251-4a0e-a56a-c1fe79c9685d of volume 6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d805669-7a4a-4f80-9417-26ccaa2439f5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:33 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 Nov 05 10:56:33 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:33 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36" returned: 0 in 0.548s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:33 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d 1G Nov 05 10:56:33 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:34 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d 1G" returned: 0 in 0.648s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:34 devstack sudo[92811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d Nov 05 10:56:34 devstack sudo[92811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:35 devstack sudo[92811]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" returned: 0 in 0.595s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:35 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d is being set with open permissions: ugo+rw Nov 05 10:56:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:35 devstack sudo[92855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d Nov 05 10:56:35 devstack sudo[92855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:35 devstack sudo[92855]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" returned: 0 in 0.630s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:35 devstack sudo[92882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info Nov 05 10:56:35 devstack sudo[92882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:36 devstack sudo[92882]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info" returned: 0 in 0.535s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:36 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info is being set with open permissions: ugo+rw Nov 05 10:56:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:36 devstack sudo[92888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info Nov 05 10:56:36 devstack sudo[92888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:36 devstack sudo[92888]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.info" returned: 0 in 0.483s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.653s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-5b9e21d9-e5a2-43e3-a047-b20e0ed58325 req-b9dc70a4-bde3-486d-bc04-6e033d0dbe6a tempest-VolumesSnapshotsTestJSON-1161887712 None] Create snapshot completed successfully Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "cinder-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "cinder-quobyte-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Deleting offline snapshot 7ca61eeb-4251-4a0e-a56a-c1fe79c9685d of volume 6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] snapshot_file for this snap is: volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6497b80-ac3f-433a-a7eb-879e7ffedd3e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:38 devstack sudo[92896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d Nov 05 10:56:38 devstack sudo[92896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (d1dc37b8-5056-4898-abca-20cac120a890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96aabc1-3183-48d5-af46-9a8cd5e70d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b96aabc1-3183-48d5-af46-9a8cd5e70d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1283264515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623452b2-0cbc-450a-9767-a2e7df02010d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:39Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4500da8-8336-4a61-b75c-53f3cdb0ce50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4500da8-8336-4a61-b75c-53f3cdb0ce50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf79120-726d-444b-b259-108cf7e30b0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ecf79120-726d-444b-b259-108cf7e30b0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623452b2-0cbc-450a-9767-a2e7df02010d', 'volume_name': 'volume-623452b2-0cbc-450a-9767-a2e7df02010d', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcb0722-9dab-45c0-96e7-7c29f4b8a0af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcb0722-9dab-45c0-96e7-7c29f4b8a0af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8742d08b-42e1-4389-9db9-6b6011d9ac1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:39 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Volume 623452b2-0cbc-450a-9767-a2e7df02010d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623452b2-0cbc-450a-9767-a2e7df02010d', 'volume_size': 1} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1283264515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623452b2-0cbc-450a-9767-a2e7df02010d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:39Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Creating volume 623452b2-0cbc-450a-9767-a2e7df02010d {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:56:39 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:56:39 devstack sudo[92896]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" returned: 0 in 0.658s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f1b4f7b-2fba-4603-a2f9-987282885a36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:56:39 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d 1073741824 Nov 05 10:56:39 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b068597-467b-4df4-8d4f-7b66d5bdcc84]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:39 devstack sudo[92903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 Nov 05 10:56:39 devstack sudo[92903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:40 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d 1073741824" returned: 0 in 0.937s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:40 devstack sudo[92903]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36" returned: 0 in 0.895s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:40 devstack sudo[92912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d Nov 05 10:56:40 devstack sudo[92912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:40 devstack sudo[92914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d Nov 05 10:56:40 devstack sudo[92914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:40 devstack sudo[92914]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d" returned: 0 in 0.483s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:40 devstack sudo[92912]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" returned: 0 in 0.553s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8742d08b-42e1-4389-9db9-6b6011d9ac1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623452b2-0cbc-450a-9767-a2e7df02010d', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:40 devstack sudo[92920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d Nov 05 10:56:40 devstack sudo[92920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2d1602-f12f-43c3-bc25-3209462329cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Volume volume-623452b2-0cbc-450a-9767-a2e7df02010d (623452b2-0cbc-450a-9767-a2e7df02010d): created successfully Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d2d1602-f12f-43c3-bc25-3209462329cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (d1dc37b8-5056-4898-abca-20cac120a890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-00c1fa31-d0dc-4372-98d9-6084c9454d73 tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:56:41 devstack sudo[92920]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36.7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" returned: 0 in 0.388s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d" released by "_delete_snapshot" :: held 2.751s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" released by "delete_snapshot" :: held 2.808s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63a021d4-5a93-4c01-a8bd-0deb78ca8089 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d" by "attach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63a021d4-5a93-4c01-a8bd-0deb78ca8089 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d" acquired by "attach_volume" :: waited 0.050s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.quota [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Created reservations ['035ce9f0-1651-49bb-8a12-3789686b7b0d', 'a2865ef4-d98a-4091-9315-ef73fda36089', '3dd3d60a-1637-4015-946d-aa9794fe1b6d', 'dfea54ff-3c8e-4833-9b97-41ca5d275c9e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-63a021d4-5a93-4c01-a8bd-0deb78ca8089 tempest-VolumesActionsTest-1265540216 None] Attaching volume 623452b2-0cbc-450a-9767-a2e7df02010d to instance aca9a1f4-ec2b-4771-b6ea-e845d6917e96 at mountpoint /dev/vdb on host None. Nov 05 10:56:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-63a021d4-5a93-4c01-a8bd-0deb78ca8089 tempest-VolumesActionsTest-1265540216 None] Attach volume completed successfully. Nov 05 10:56:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Delete snapshot completed successfully. Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-8f2e0569-ab94-45a9-847b-977558da9b27 req-883ba00d-8583-4915-8c39-cb9cf50956f0 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-7ca61eeb-4251-4a0e-a56a-c1fe79c9685d-delete_snapshot" released by "delete_snapshot" :: held 3.211s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63a021d4-5a93-4c01-a8bd-0deb78ca8089 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d" released by "attach_volume" :: held 0.224s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "cinder-6f1b4f7b-2fba-4603-a2f9-987282885a36-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-6f1b4f7b-2fba-4603-a2f9-987282885a36-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2088c398-ff4c-4c13-9c1e-91048faa024f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:42 devstack sudo[92923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 Nov 05 10:56:42 devstack sudo[92923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Terminate volume connection completed successfully. Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" by "detach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" acquired by "detach_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:43 devstack sudo[92923]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36" returned: 0 in 0.738s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:43 devstack sudo[92928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36 Nov 05 10:56:43 devstack sudo[92928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Detaching volume 623452b2-0cbc-450a-9767-a2e7df02010d from instance aca9a1f4-ec2b-4771-b6ea-e845d6917e96. Nov 05 10:56:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Detach volume completed successfully. Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-05614c5a-f13e-41e0-8b28-d6758fca9ec0 tempest-VolumesActionsTest-132060865 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" released by "detach_volume" :: held 0.223s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c721d3f-5f91-4076-8dcd-9c7197d90e81 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" by "detach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:43 devstack sudo[92928]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f1b4f7b-2fba-4603-a2f9-987282885a36" returned: 0 in 0.568s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c721d3f-5f91-4076-8dcd-9c7197d90e81 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9c721d3f-5f91-4076-8dcd-9c7197d90e81 tempest-VolumesActionsTest-1265540216 None] Volume detach called, but volume not attached. Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-quobyte-6f1b4f7b-2fba-4603-a2f9-987282885a36" released by "delete_volume" :: held 1.457s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9c721d3f-5f91-4076-8dcd-9c7197d90e81 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-detach_volume" released by "detach_volume" :: held 0.050s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.quota [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Created reservations ['50cbec67-e256-40d4-b5e2-7c7834b2c651', 'b72295b5-b75c-4f48-b304-b4510c3b4db2', '6940ec66-123d-4a26-b9e5-40e9a52cfc3f', '7f0b823f-8216-4e60-b20c-733721644943'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:44 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:44 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-quobyte-623452b2-0cbc-450a-9767-a2e7df02010d" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "cinder-quobyte-623452b2-0cbc-450a-9767-a2e7df02010d" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e5ad5d8-7084-494d-95e9-b5cca1df0a73]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:44 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d Nov 05 10:56:44 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:44 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.563s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.manager [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Deleted volume successfully. Nov 05 10:56:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-13ee800a-7a58-447c-8462-34700e483a70 req-9750809c-7d13-4bd8-9349-2665a74cbee9 tempest-VolumesSnapshotsTestJSON-1161887712 None] Lock "cinder-6f1b4f7b-2fba-4603-a2f9-987282885a36-delete_volume" released by "delete_volume" :: held 2.574s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:45 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d" returned: 0 in 0.601s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:45 devstack sudo[92940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d Nov 05 10:56:45 devstack sudo[92940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:45 devstack sudo[92940]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-623452b2-0cbc-450a-9767-a2e7df02010d" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "cinder-quobyte-623452b2-0cbc-450a-9767-a2e7df02010d" released by "delete_volume" :: held 1.165s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Created reservations ['65f437a8-f7b5-4747-bd32-6c7df6da6bad', '058b2130-f65f-4c18-a17a-91c94b16be97', 'cf22bb59-1359-4a72-9840-c1440cc141a5', 'daf5b85c-54fb-4176-bf4a-54b46774fd24'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:45 devstack sudo[92943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:45 devstack sudo[92943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:46 devstack sudo[92943]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.514s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:46 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Deleted volume successfully. Nov 05 10:56:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ea36d05-5e5b-4376-ab56-ab6d951819cb tempest-VolumesActionsTest-1265540216 None] Lock "cinder-623452b2-0cbc-450a-9767-a2e7df02010d-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:50 devstack sudo[92972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:56:50 devstack sudo[92972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:50 devstack sudo[92972]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.342s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 9 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:56:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:56:55 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=35,cinder:SELECT=30,cinder:DELETE=2,cinder:INSERT=11 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:56 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=31,cinder:UPDATE=30,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:56:56 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:56:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (a0cd0045-e23a-4c5c-a17c-d6bdcf18156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb275759-71fe-4f4c-8fd4-ae8a71455a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb275759-71fe-4f4c-8fd4-ae8a71455a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735692394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09a9237-2784-4c92-a63a-8a2cbc78f5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:57Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a40bc0a-b0c3-49a5-8f47-5dd63c81a7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a40bc0a-b0c3-49a5-8f47-5dd63c81a7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f9133e-846f-4861-9eae-7abe0d1f7d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77f9133e-846f-4861-9eae-7abe0d1f7d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b09a9237-2784-4c92-a63a-8a2cbc78f5a9', 'volume_name': 'volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a814455-2c7a-4c41-81e5-e5e18626964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a814455-2c7a-4c41-81e5-e5e18626964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d868f-383a-4720-8abf-91eebb735696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Volume b09a9237-2784-4c92-a63a-8a2cbc78f5a9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9', 'volume_size': 1} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1735692394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b09a9237-2784-4c92-a63a-8a2cbc78f5a9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:56:57Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Creating volume b09a9237-2784-4c92-a63a-8a2cbc78f5a9 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:56:57 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:57 devstack sudo[92977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 1073741824 Nov 05 10:56:57 devstack sudo[92977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:57 devstack sudo[92977]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 1073741824" returned: 0 in 0.631s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:57 devstack sudo[92984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 Nov 05 10:56:57 devstack sudo[92984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:56:58 devstack sudo[92984]: pam_unix(sudo:session): session closed for user root Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" returned: 0 in 0.494s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (124d868f-383a-4720-8abf-91eebb735696) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf95c31-f335-4c8b-a879-f4534c66ddef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:56:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Volume volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 (b09a9237-2784-4c92-a63a-8a2cbc78f5a9): created successfully Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bf95c31-f335-4c8b-a879-f4534c66ddef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:56:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (a0cd0045-e23a-4c5c-a17c-d6bdcf18156c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:56:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0f4bab18-3381-49dc-bcc1-217ecdf4e4f0 tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-b09a9237-2784-4c92-a63a-8a2cbc78f5a9-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "cinder-b09a9237-2784-4c92-a63a-8a2cbc78f5a9-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-quobyte-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ac04622-b13b-482a-8c35-82689518849e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:56:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:56:59 devstack sudo[92987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 Nov 05 10:56:59 devstack sudo[92987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:00 devstack sudo[92987]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" returned: 0 in 0.546s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:00 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9 Nov 05 10:57:00 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:00 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-b09a9237-2784-4c92-a63a-8a2cbc78f5a9" released by "delete_volume" :: held 1.057s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Created reservations ['68feb8c5-b327-4896-b67a-a0a3ff65fe9d', 'abf66c6c-8a1f-467f-9e24-ddedff46a75c', '56bd2cac-675b-47d7-afbc-12a4265cca52', '9f935575-324c-45f1-aed3-0d523b48c2f6'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:00 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:00 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:01 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.398s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:01 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Deleted volume successfully. Nov 05 10:57:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ad8733e2-ff95-42b4-9a76-72b25827df5a tempest-VolumesActionsTest-132060865 None] Lock "cinder-b09a9237-2784-4c92-a63a-8a2cbc78f5a9-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (94f6bbb8-4fef-4a1d-9ed3-f1c33b56205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14104171-9f56-4693-b39a-3ff7481aceaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14104171-9f56-4693-b39a-3ff7481aceaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1466815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e04bf-8d42-4373-83b4-539259929771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:03Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e979882-3df7-4f97-b576-a19c14d3af5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e979882-3df7-4f97-b576-a19c14d3af5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95c8161-c9e1-4312-b771-d62c11447c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95c8161-c9e1-4312-b771-d62c11447c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '876e04bf-8d42-4373-83b4-539259929771', 'volume_name': 'volume-876e04bf-8d42-4373-83b4-539259929771', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc19f8f3-d98d-48e4-9a33-91a18ca236c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc19f8f3-d98d-48e4-9a33-91a18ca236c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a5f84-34dc-4b7a-a830-352f5b5d3c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:02 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Volume 876e04bf-8d42-4373-83b4-539259929771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-876e04bf-8d42-4373-83b4-539259929771', 'volume_size': 1} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1466815536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=876e04bf-8d42-4373-83b4-539259929771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:03Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Creating volume 876e04bf-8d42-4373-83b4-539259929771 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:02 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:02 devstack sudo[93003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 1073741824 Nov 05 10:57:02 devstack sudo[93003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:03 devstack sudo[93003]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 1073741824" returned: 0 in 0.909s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:03 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 Nov 05 10:57:03 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:04 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771" returned: 0 in 0.476s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.484s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a7a5f84-34dc-4b7a-a830-352f5b5d3c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-876e04bf-8d42-4373-83b4-539259929771', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32c6e81-c917-4b30-a687-f41be9fe3945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:04 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Volume volume-876e04bf-8d42-4373-83b4-539259929771 (876e04bf-8d42-4373-83b4-539259929771): created successfully Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d32c6e81-c917-4b30-a687-f41be9fe3945) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (94f6bbb8-4fef-4a1d-9ed3-f1c33b56205b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-71bb46b4-2124-41a2-afd6-91e33226352f tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:57:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e238b4d0-fea7-4c9a-8bc0-dd667302c94d tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-1709428702: creating Nov 05 10:57:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e238b4d0-fea7-4c9a-8bc0-dd667302c94d tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-1709428702: created successfully Nov 05 10:57:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e238b4d0-fea7-4c9a-8bc0-dd667302c94d tempest-GroupSnapshotsTest-1575266435 None] Create group completed successfully. Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-876e04bf-8d42-4373-83b4-539259929771-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "cinder-876e04bf-8d42-4373-83b4-539259929771-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-quobyte-876e04bf-8d42-4373-83b4-539259929771" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-876e04bf-8d42-4373-83b4-539259929771" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[035c4233-9825-4ab8-809d-25abe9b724a2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:05 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 Nov 05 10:57:05 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:05 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771" returned: 0 in 0.595s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:05 devstack sudo[93042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771 Nov 05 10:57:05 devstack sudo[93042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:06 devstack sudo[93042]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-876e04bf-8d42-4373-83b4-539259929771" returned: 0 in 0.453s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-876e04bf-8d42-4373-83b4-539259929771" released by "delete_volume" :: held 1.124s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Created reservations ['dcb1f7ed-9ae4-4605-ab4c-216e09936330', '0ebe53ea-e1ec-4ff0-9a16-27d32f3ab1a8', '3aae719b-7725-4c1e-9d35-eac394dc282c', '88bb07f5-5359-4e9c-b091-096d731d6518'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:06 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:06 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (56262d99-c3cd-4fb2-9404-bb567e516890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885dd0ce-0018-40b7-8600-104785364fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (885dd0ce-0018-40b7-8600-104785364fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7172494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f68c81d-43bd-4aa3-8f07-e2c674c1f50b,host='devstack@QuobyteHD#QuobyteHD',id=e7504ddd-3fec-4b78-a2e6-1ed79802b4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:07Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb4a4d4-84d5-4a5d-a5f3-ddb1225e9c9d),volume_type_id=5eb4a4d4-84d5-4a5d-a5f3-ddb1225e9c9d)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b65ed9-95f6-450f-a939-390911167817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27b65ed9-95f6-450f-a939-390911167817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0210f97b-7b04-4831-9b1d-cb7b83f10878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0210f97b-7b04-4831-9b1d-cb7b83f10878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7504ddd-3fec-4b78-a2e6-1ed79802b4b2', 'volume_name': 'volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5e9f97-ec4d-4b8c-8c2e-90f9f9609eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb5e9f97-ec4d-4b8c-8c2e-90f9f9609eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6864e38a-e7c8-4ffe-ad55-b3037034a2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:06 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Volume e7504ddd-3fec-4b78-a2e6-1ed79802b4b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2', 'volume_size': 1} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7f68c81d-43bd-4aa3-8f07-e2c674c1f50b,created_at=2026-11-05T09:57:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-7172494',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7f68c81d-43bd-4aa3-8f07-e2c674c1f50b,host='devstack@QuobyteHD#QuobyteHD',id=e7504ddd-3fec-4b78-a2e6-1ed79802b4b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:07Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5eb4a4d4-84d5-4a5d-a5f3-ddb1225e9c9d),volume_type_id=5eb4a4d4-84d5-4a5d-a5f3-ddb1225e9c9d)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Creating volume e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:06 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:07 devstack sudo[93049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 1073741824 Nov 05 10:57:07 devstack sudo[93049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:07 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.464s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:07 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:07 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Deleted volume successfully. Nov 05 10:57:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74824f63-b48c-4d57-bd77-1f71c54d682d tempest-VolumesActionsTest-132060865 None] Lock "cinder-876e04bf-8d42-4373-83b4-539259929771-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:07 devstack sudo[93049]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 1073741824" returned: 0 in 0.736s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:07 devstack sudo[93057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:07 devstack sudo[93057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:08 devstack sudo[93057]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (1cceb2c7-0f10-4461-9548-94bb517d13d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b18df-962a-4b5f-bc02-0e4b8fd98ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.698s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6864e38a-e7c8-4ffe-ad55-b3037034a2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed72df-a485-4ba8-8e61-6c7e7a228293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f02b18df-962a-4b5f-bc02-0e4b8fd98ed3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1769517825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ac785-6c7a-40a9-8cda-928de523e528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:08Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232917ec-7dd6-42b6-bf27-4115ead25388) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (232917ec-7dd6-42b6-bf27-4115ead25388) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d03149-0304-4039-b40d-4dfb3c2a9073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03d03149-0304-4039-b40d-4dfb3c2a9073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '224ac785-6c7a-40a9-8cda-928de523e528', 'volume_name': 'volume-224ac785-6c7a-40a9-8cda-928de523e528', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa702bfb-70b1-49f8-9e3c-33eb1cef1330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa702bfb-70b1-49f8-9e3c-33eb1cef1330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be1b6fa-72a5-4e50-8719-9c3040b8d1fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:08 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Volume 224ac785-6c7a-40a9-8cda-928de523e528: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-224ac785-6c7a-40a9-8cda-928de523e528', 'volume_size': 1} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1769517825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=224ac785-6c7a-40a9-8cda-928de523e528,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:08Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Creating volume 224ac785-6c7a-40a9-8cda-928de523e528 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:08 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:08 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Volume volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 (e7504ddd-3fec-4b78-a2e6-1ed79802b4b2): created successfully Nov 05 10:57:08 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 1073741824 Nov 05 10:57:08 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5ed72df-a485-4ba8-8e61-6c7e7a228293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (56262d99-c3cd-4fb2-9404-bb567e516890) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:08 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-abf86a8d-60f3-4270-8cf7-00617730db31 tempest-GroupSnapshotsTest-1575266435 None] Created volume successfully. Nov 05 10:57:09 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 1073741824" returned: 0 in 1.131s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:10 devstack sudo[93146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 Nov 05 10:57:10 devstack sudo[93146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:10 devstack sudo[93146]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] GroupSnapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: creating. Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528" returned: 0 in 0.530s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.780s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Group snapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: creating. {{(pid=87369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9be1b6fa-72a5-4e50-8719-9c3040b8d1fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-224ac785-6c7a-40a9-8cda-928de523e528', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d17414d-dbd9-45fa-983b-553c5e48bbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Creating offline snapshot 5e03f07b-240e-4d08-9dc1-43ef9a9af62b of volume e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:57:10 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Volume volume-224ac785-6c7a-40a9-8cda-928de523e528 (224ac785-6c7a-40a9-8cda-928de523e528): created successfully Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d17414d-dbd9-45fa-983b-553c5e48bbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (1cceb2c7-0f10-4461-9548-94bb517d13d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[34152e86-e83a-4b9c-91fb-fca6e7acffd0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1cae9479-1c2f-4e52-be35-31b3bca2c049 tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:57:10 devstack sudo[93151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:10 devstack sudo[93151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:11 devstack sudo[93151]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.746s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:11 devstack sudo[93159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b 1G Nov 05 10:57:11 devstack sudo[93159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:12 devstack sudo[93159]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b 1G" returned: 0 in 0.815s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:12 devstack sudo[93164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:12 devstack sudo[93164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-224ac785-6c7a-40a9-8cda-928de523e528-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "cinder-224ac785-6c7a-40a9-8cda-928de523e528-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-quobyte-224ac785-6c7a-40a9-8cda-928de523e528" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-224ac785-6c7a-40a9-8cda-928de523e528" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff693d6e-f2c4-4edc-ada0-c444a1826a94]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:12 devstack sudo[93166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 Nov 05 10:57:12 devstack sudo[93166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:12 devstack sudo[93164]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.684s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:12 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:57:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:12 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:12 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:13 devstack sudo[93166]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528" returned: 0 in 0.733s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:13 devstack sudo[93177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528 Nov 05 10:57:13 devstack sudo[93177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:13 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.457s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:13 devstack sudo[93194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info Nov 05 10:57:13 devstack sudo[93194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:13 devstack sudo[93177]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-224ac785-6c7a-40a9-8cda-928de523e528" returned: 0 in 0.749s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-224ac785-6c7a-40a9-8cda-928de523e528" released by "delete_volume" :: held 1.630s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:14 devstack sudo[93194]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info" returned: 0 in 0.717s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:14 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Created reservations ['9d41ab06-ec15-45f7-987e-237793e9ce50', '6c839412-8645-4f35-8360-91172ae72b2e', 'fa756744-e533-46d0-8337-ab7e9fa18807', '07e3d32f-e721-4339-9152-1be5e925dfdc'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:14 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info Nov 05 10:57:14 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:14 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:14 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:14 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.379s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Deleted volume successfully. Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a42f0756-6a03-423c-949c-68f674570675 tempest-VolumesActionsTest-132060865 None] Lock "cinder-224ac785-6c7a-40a9-8cda-928de523e528-delete_volume" released by "delete_volume" :: held 2.579s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:14 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.info" returned: 0 in 0.833s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.448s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d77c9f25-4bbf-4de8-8ab7-6f917dc9f66d tempest-GroupSnapshotsTest-1575266435 None] group_snapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: created successfully Nov 05 10:57:16 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (e1aa53a8-c813-4101-beb8-7b2771330cf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e5ff9-c2c3-443f-aab1-314b4a35e136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a64e5ff9-c2c3-443f-aab1-314b4a35e136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-67829995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbf2376-400a-4a61-a38f-19e6818eae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:17Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6603e1-571c-4423-b5ad-ebde228e734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d6603e1-571c-4423-b5ad-ebde228e734f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185de38c-3cca-490c-93d7-f4d79b362082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (185de38c-3cca-490c-93d7-f4d79b362082) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcbf2376-400a-4a61-a38f-19e6818eae48', 'volume_name': 'volume-bcbf2376-400a-4a61-a38f-19e6818eae48', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee82c3d-77d3-4a46-ad59-78354e4d2f17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fee82c3d-77d3-4a46-ad59-78354e4d2f17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a498e1-4a5e-46ca-a070-fabb90b476a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Volume bcbf2376-400a-4a61-a38f-19e6818eae48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcbf2376-400a-4a61-a38f-19e6818eae48', 'volume_size': 1} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-67829995',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcbf2376-400a-4a61-a38f-19e6818eae48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:17Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Creating volume bcbf2376-400a-4a61-a38f-19e6818eae48 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:17 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:17 devstack sudo[93292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 1073741824 Nov 05 10:57:17 devstack sudo[93292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:18 devstack sudo[93292]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 1073741824" returned: 0 in 1.283s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:18 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 Nov 05 10:57:18 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:19 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48" returned: 0 in 0.527s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (1898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.904s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.708s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70a498e1-4a5e-46ca-a070-fabb90b476a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcbf2376-400a-4a61-a38f-19e6818eae48', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8f996-5c98-4825-af6f-403e008dd51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Creating volume 8dc31aca-e3ce-4de0-8d8b-077ea4880c64 from snapshot 5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Volume volume-bcbf2376-400a-4a61-a38f-19e6818eae48 (bcbf2376-400a-4a61-a38f-19e6818eae48): created successfully Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8f996-5c98-4825-af6f-403e008dd51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (e1aa53a8-c813-4101-beb8-7b2771330cf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" acquired by "_copy_volume_from_snapshot" :: waited 0.053s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] snapshot: 5e03f07b-240e-4d08-9dc1-43ef9a9af62b, volume: 8dc31aca-e3ce-4de0-8d8b-077ea4880c64, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 10:57:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-78babb26-0f8b-485d-a00e-f335bf6480a3 tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a114c56f-5be6-451a-b6d9-43c8f0359654]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:19 devstack sudo[93315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:19 devstack sudo[93315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:19 devstack sudo[93315]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.363s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd13cc22-9c4a-49a5-a04c-179ea09accba]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:19 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:19 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:20 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.536s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:20 devstack sudo[93326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 Nov 05 10:57:20 devstack sudo[93326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-bcbf2376-400a-4a61-a38f-19e6818eae48-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "cinder-bcbf2376-400a-4a61-a38f-19e6818eae48-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Acquiring lock "cinder-quobyte-bcbf2376-400a-4a61-a38f-19e6818eae48" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-bcbf2376-400a-4a61-a38f-19e6818eae48" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba6da73-a596-43e3-982b-0a3f5ffc08e2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:21 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 Nov 05 10:57:21 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:22 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48" returned: 0 in 1.673s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:22 devstack sudo[93359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48 Nov 05 10:57:22 devstack sudo[93359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:23 devstack sudo[93359]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bcbf2376-400a-4a61-a38f-19e6818eae48" returned: 0 in 1.052s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "cinder-quobyte-bcbf2376-400a-4a61-a38f-19e6818eae48" released by "delete_volume" :: held 2.829s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:23 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Created reservations ['830a3b2e-b824-4bfe-8391-00455e0a4203', 'b826a5f6-56bd-4138-8163-84249d5ac8e5', '5895c5ed-9c44-4438-90bf-d05fcd5426f3', '3ce7b54a-94d7-4335-a3d9-d27ec7b87afa'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:24 devstack sudo[93363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:24 devstack sudo[93363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:25 devstack sudo[93363]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 1.149s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:25 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Deleted volume successfully. Nov 05 10:57:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ef1565f9-0ff0-493e-9731-f5bcb9f36ddd tempest-VolumesActionsTest-132060865 None] Lock "cinder-bcbf2376-400a-4a61-a38f-19e6818eae48-delete_volume" released by "delete_volume" :: held 4.801s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (5ce6d9f6-e68a-4ec8-988a-495ccf751693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b626643-d51c-4eec-8f96-7aa1e4d1df95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b626643-d51c-4eec-8f96-7aa1e4d1df95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458221543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd03ae60-dfd8-4104-a36e-f2b559886c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:27Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7607e90-8733-4525-8ba9-bbfd44288620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7607e90-8733-4525-8ba9-bbfd44288620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9916f8e-a423-4ed9-aa39-5da44fe16e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9916f8e-a423-4ed9-aa39-5da44fe16e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd03ae60-dfd8-4104-a36e-f2b559886c2b', 'volume_name': 'volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa3198e-5a1c-41fa-a2a2-33ad2b387343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daa3198e-5a1c-41fa-a2a2-33ad2b387343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2471b2-9387-43ab-8219-12e82df44cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:27 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Volume dd03ae60-dfd8-4104-a36e-f2b559886c2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b', 'volume_size': 1} Nov 05 10:57:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:30 devstack sudo[93326]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" returned: 0 in 10.474s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:30 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2, size 1024.00 MB, duration 10.48 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 10:57:30 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Converted 1024.00 MB image at 97.75 MB/s Nov 05 10:57:30 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:57:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:30 devstack sudo[93403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 Nov 05 10:57:30 devstack sudo[93403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:30 devstack sudo[93403]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" returned: 0 in 0.280s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" released by "_copy_volume_from_snapshot" :: held 11.783s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" released by "_create_volume_from_snapshot" :: held 11.913s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.955s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.697s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1458221543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd03ae60-dfd8-4104-a36e-f2b559886c2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3212a4bb72174f0cabbd964023213652',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:27Z,use_quota=True,user_id='d01c8cbf6f6148a38ee7d1c9b448d1da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Creating volume dd03ae60-dfd8-4104-a36e-f2b559886c2b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:31 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:31 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b 1073741824 Nov 05 10:57:31 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5c848c8a-91b7-4ec5-8f7a-9bb906e5f2e7 tempest-GroupSnapshotsTest-1575266435 None] Create group from source-snapshot-ccfb1727-88cf-47f9-bf96-9cd3015b85f0 completed successfully. Nov 05 10:57:31 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b 1073741824" returned: 0 in 0.496s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:31 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b Nov 05 10:57:31 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:31 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] <== create_volume: return (836ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a2471b2-9387-43ab-8219-12e82df44cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fa9861-5671-4ee0-928d-1fba5ccd6765) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:31 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Volume volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b (dd03ae60-dfd8-4104-a36e-f2b559886c2b): created successfully Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3fa9861-5671-4ee0-928d-1fba5ccd6765) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Flow 'volume_create_manager' (5ce6d9f6-e68a-4ec8-988a-495ccf751693) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-eaacd2c1-cf89-49ed-a094-d7ac838b2e54 tempest-VolumesActionsTest-1265540216 None] Created volume successfully. Nov 05 10:57:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" acquired by "delete_volume" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ddf1aa-a2a6-4828-92e8-db53b365353e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:33 devstack sudo[93434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 Nov 05 10:57:33 devstack sudo[93434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-dd03ae60-dfd8-4104-a36e-f2b559886c2b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-dd03ae60-dfd8-4104-a36e-f2b559886c2b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "cinder-quobyte-dd03ae60-dfd8-4104-a36e-f2b559886c2b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-quobyte-dd03ae60-dfd8-4104-a36e-f2b559886c2b" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:33 devstack sudo[93434]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" returned: 0 in 0.468s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6aaafd7-1b11-46e1-94af-287e358fbd14]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:33 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64 Nov 05 10:57:33 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:33 devstack sudo[93440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b Nov 05 10:57:33 devstack sudo[93440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:33 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" returned: 0 in 0.260s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-8dc31aca-e3ce-4de0-8d8b-077ea4880c64" released by "delete_volume" :: held 0.800s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['59d08dc0-ee10-4055-86e5-813e311fb953'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:33 devstack cinder-volume[87369]: WARNING cinder.quota [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-515302730 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-515302730, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:57:33 devstack cinder-volume[87369]: WARNING cinder.quota [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-515302730 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-515302730, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['4b97aae4-001d-4460-9aa8-272a0bc0176d', '06ed01af-a285-4f99-80e1-3662f8abb8a4', '5a845f21-df88-4414-8d6d-ed4df7b9e9f2', 'b8886c5b-6e4e-43c4-8b4c-d5a9fd07dea3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:33 devstack sudo[93440]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b" returned: 0 in 0.420s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:33 devstack sudo[93447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b Nov 05 10:57:33 devstack sudo[93447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:34 devstack sudo[93449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:34 devstack sudo[93449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:34 devstack sudo[93447]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dd03ae60-dfd8-4104-a36e-f2b559886c2b" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: deleting Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-quobyte-dd03ae60-dfd8-4104-a36e-f2b559886c2b" released by "delete_volume" :: held 0.792s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: deleting {{(pid=87369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:34 devstack sudo[93449]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-02ed6a7e-7b2f-4d72-ade5-a684e4545a0a tempest-GroupSnapshotsTest-1575266435 None] Delete group completed successfully. Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Created reservations ['e69b3d59-6913-404e-bdb0-20664ed0fa71', '1cc1a8e6-9a2a-4e8c-8c6a-43ceb3da4b79', '7087c56b-3756-4bd7-bb3c-675f173ecbf2', '28fa4580-b7ce-4691-aa3b-a8a17e18ccdd'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Deleting offline snapshot 5e03f07b-240e-4d08-9dc1-43ef9a9af62b of volume e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] snapshot_file for this snap is: volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b14969ce-8387-4ad6-b747-d50eb1be168e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:34 devstack sudo[93454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:34 devstack sudo[93454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:34 devstack sudo[93453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:34 devstack sudo[93453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:34 devstack sudo[93454]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Deleted volume successfully. Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb2b4b72-cb31-431d-b118-e0265d3c0d70 tempest-VolumesActionsTest-1265540216 None] Lock "cinder-dd03ae60-dfd8-4104-a36e-f2b559886c2b-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:34 devstack sudo[93453]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.442s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e524e11-c04b-4c2d-a09c-6d090a4bf86c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:34 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:34 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:35 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.595s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:35 devstack sudo[93466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:35 devstack sudo[93466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:35 devstack sudo[93466]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.487s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:35 devstack sudo[93474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b Nov 05 10:57:35 devstack sudo[93474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:36 devstack sudo[93474]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2.5e03f07b-240e-4d08-9dc1-43ef9a9af62b" returned: 0 in 0.331s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-5e03f07b-240e-4d08-9dc1-43ef9a9af62b" released by "_delete_snapshot" :: held 1.987s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" released by "delete_snapshot" :: held 2.029s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:36 devstack cinder-volume[87369]: WARNING cinder.quota [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-515302730 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-515302730, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['260fc207-0ca8-4f76-b707-789f7ceb6e12', 'bebf89a8-08a9-487e-95aa-6d9b091c1a1f', '7ab86a00-85b8-4417-bbaf-d36e3f79f929', 'e09f5f87-34cb-48f6-8474-cd2ffb8d0eee'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-84ece74f-02ed-4fba-92c0-7e3e014e0241 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot ccfb1727-88cf-47f9-bf96-9cd3015b85f0: deleted successfully Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (dfdfcb8d-d6a7-46da-a239-5181b5107fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871b0556-2381-496c-a5af-85a0992c3b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (871b0556-2381-496c-a5af-85a0992c3b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153267948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff42bd3e-b036-4d7c-9f49-6b8864e471b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:37Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628fff08-4a06-4833-929e-06699f0f98d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628fff08-4a06-4833-929e-06699f0f98d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bbf2e6-2855-4c6e-8abe-990ab307b4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9bbf2e6-2855-4c6e-8abe-990ab307b4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff42bd3e-b036-4d7c-9f49-6b8864e471b7', 'volume_name': 'volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2c451b-bfec-4df1-b59c-b6dfdde766b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a2c451b-bfec-4df1-b59c-b6dfdde766b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebbb777-03ba-46ad-9612-30ddd626f67e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:36 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Volume ff42bd3e-b036-4d7c-9f49-6b8864e471b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7', 'volume_size': 1} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1153267948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff42bd3e-b036-4d7c-9f49-6b8864e471b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:37Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Creating volume ff42bd3e-b036-4d7c-9f49-6b8864e471b7 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:36 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:36 devstack sudo[93478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 1073741824 Nov 05 10:57:36 devstack sudo[93478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:37 devstack sudo[93478]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 1073741824" returned: 0 in 0.500s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:37 devstack sudo[93485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 Nov 05 10:57:37 devstack sudo[93485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:37 devstack sudo[93485]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" returned: 0 in 0.325s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebbb777-03ba-46ad-9612-30ddd626f67e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c905dd-82f2-441b-a31a-4a60ab66491c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:37 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Volume volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 (ff42bd3e-b036-4d7c-9f49-6b8864e471b7): created successfully Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05c905dd-82f2-441b-a31a-4a60ab66491c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (dfdfcb8d-d6a7-46da-a239-5181b5107fec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-85e6ed3d-cf7e-499d-abb4-70a0e1f82423 tempest-AttachVolumeNegativeTest-2110355174 None] Created volume successfully. Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bd2d40-cc25-40a8-a182-7d42fe81aebc]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:38 devstack sudo[93490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:38 devstack sudo[93490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:38 devstack sudo[93490]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.497s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:38 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2 Nov 05 10:57:38 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:38 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" returned: 0 in 0.397s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-e7504ddd-3fec-4b78-a2e6-1ed79802b4b2" released by "delete_volume" :: held 0.979s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['a8de5cdd-e715-41bd-9a98-2938aefd132c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:38 devstack cinder-volume[87369]: WARNING cinder.db.api [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-515302730'] Nov 05 10:57:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['6a76bcb3-59fe-4bf2-8e92-964346e403ff', '33faa734-2ac9-45ba-bf44-ec6aca02915e', '8259c2d5-1d8b-405b-bf75-8cd62bdabb84', '4cfff632-80df-4923-a17e-20aa85f8fc6f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:39 devstack sudo[93502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:39 devstack sudo[93502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:39 devstack sudo[93502]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.380s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b9ab7bab-109c-4724-9588-62c886a17f48 tempest-GroupSnapshotsTest-1575266435 None] Delete group completed successfully. Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7e1e8ab0-fc56-4673-bd42-ce3a43e6671b req-e11c9774-040c-4b75-a8e8-39f983ce622f tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7e1e8ab0-fc56-4673-bd42-ce3a43e6671b req-e11c9774-040c-4b75-a8e8-39f983ce622f tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7e1e8ab0-fc56-4673-bd42-ce3a43e6671b req-e11c9774-040c-4b75-a8e8-39f983ce622f tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-7e1e8ab0-fc56-4673-bd42-ce3a43e6671b req-e11c9774-040c-4b75-a8e8-39f983ce622f tempest-AttachVolumeNegativeTest-2110355174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a1fe6e88-cd59-43ac-94f4-ceaea28fca11', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:57:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-7e1e8ab0-fc56-4673-bd42-ce3a43e6671b req-e11c9774-040c-4b75-a8e8-39f983ce622f tempest-AttachVolumeNegativeTest-2110355174 None] attachment_update completed successfully. Nov 05 10:57:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74a59670-e469-4e59-9a73-a60d286342ab tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-564807786: creating Nov 05 10:57:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74a59670-e469-4e59-9a73-a60d286342ab tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-564807786: created successfully Nov 05 10:57:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74a59670-e469-4e59-9a73-a60d286342ab tempest-GroupSnapshotsTest-1575266435 None] Create group completed successfully. Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (55bd93dd-9265-45a3-8331-d82befb2de35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b322cbe9-5bf4-4cdd-96be-ad04ce6668a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b322cbe9-5bf4-4cdd-96be-ad04ce6668a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471009187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=596887dc-115f-4258-b15f-d7f509a2dd57,host='devstack@QuobyteHD#QuobyteHD',id=12374447-e466-4207-85a0-683bd9b8c644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:43Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9b5d8d-2d7f-4293-bce1-20f5cb494e55),volume_type_id=fb9b5d8d-2d7f-4293-bce1-20f5cb494e55)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc91c338-d8f5-490e-9055-c98b17ab5d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc91c338-d8f5-490e-9055-c98b17ab5d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a03347-faf1-486c-a134-ba917fad1fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18a03347-faf1-486c-a134-ba917fad1fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12374447-e466-4207-85a0-683bd9b8c644', 'volume_name': 'volume-12374447-e466-4207-85a0-683bd9b8c644', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a91b4-07f3-4e92-825d-93a32280c18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b2a91b4-07f3-4e92-825d-93a32280c18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec10ad7-81bd-4d55-bc63-255fea4036ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Volume 12374447-e466-4207-85a0-683bd9b8c644: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12374447-e466-4207-85a0-683bd9b8c644', 'volume_size': 1} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=596887dc-115f-4258-b15f-d7f509a2dd57,created_at=2026-11-05T09:57:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1471009187',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=596887dc-115f-4258-b15f-d7f509a2dd57,host='devstack@QuobyteHD#QuobyteHD',id=12374447-e466-4207-85a0-683bd9b8c644,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:43Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9b5d8d-2d7f-4293-bce1-20f5cb494e55),volume_type_id=fb9b5d8d-2d7f-4293-bce1-20f5cb494e55)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Creating volume 12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:43 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 1073741824 Nov 05 10:57:43 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:43 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 1073741824" returned: 0 in 0.602s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:43 devstack sudo[93940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 Nov 05 10:57:43 devstack sudo[93940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:43 devstack sudo[93940]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644" returned: 0 in 0.323s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ec10ad7-81bd-4d55-bc63-255fea4036ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12374447-e466-4207-85a0-683bd9b8c644', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b8b86-983b-4099-ba8c-e54dad937b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Volume volume-12374447-e466-4207-85a0-683bd9b8c644 (12374447-e466-4207-85a0-683bd9b8c644): created successfully Nov 05 10:57:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de6b8b86-983b-4099-ba8c-e54dad937b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (55bd93dd-9265-45a3-8331-d82befb2de35) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f3892fcb-d04f-4096-8e91-98e5fb45d8a8 tempest-GroupSnapshotsTest-1575266435 None] Created volume successfully. Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Flow 'volume_create_manager' (7316e841-eb70-455f-8f94-744d072fd75f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a212ec-acca-4db2-bf64-c145e6fb56e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10a212ec-acca-4db2-bf64-c145e6fb56e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-752743218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95fa2d0-7629-485f-afe1-0d30d569775f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d65e0d967547e7bf6245fbbf2eab61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:45Z,use_quota=True,user_id='062653a3378143e0b2f15a496c2dc517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bd1750-8baa-4211-92a5-2e7e643c206b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01bd1750-8baa-4211-92a5-2e7e643c206b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc46644a-39c6-488e-bd2f-58585107b40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc46644a-39c6-488e-bd2f-58585107b40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f95fa2d0-7629-485f-afe1-0d30d569775f', 'volume_name': 'volume-f95fa2d0-7629-485f-afe1-0d30d569775f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b12b89-65fb-48e8-9eaf-9768e869d082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3b12b89-65fb-48e8-9eaf-9768e869d082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1550c2e-a366-4d6e-93c7-39a8ea9af0f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Volume f95fa2d0-7629-485f-afe1-0d30d569775f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f95fa2d0-7629-485f-afe1-0d30d569775f', 'volume_size': 1} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-752743218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f95fa2d0-7629-485f-afe1-0d30d569775f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d65e0d967547e7bf6245fbbf2eab61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:45Z,use_quota=True,user_id='062653a3378143e0b2f15a496c2dc517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Creating volume f95fa2d0-7629-485f-afe1-0d30d569775f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:45 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f 1073741824 Nov 05 10:57:45 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (39414282-3830-44a2-9fbc-6a4f088def40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7a0b3f-bf1e-405a-977a-00958bcaf1dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7a0b3f-bf1e-405a-977a-00958bcaf1dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167040834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=596887dc-115f-4258-b15f-d7f509a2dd57,host='devstack@QuobyteHD#QuobyteHD',id=c643d6ae-db05-47e2-a1bb-0222dfb08412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:46Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9b5d8d-2d7f-4293-bce1-20f5cb494e55),volume_type_id=fb9b5d8d-2d7f-4293-bce1-20f5cb494e55)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d679da-633f-44cf-b095-71a85783624d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59d679da-633f-44cf-b095-71a85783624d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84ccb90-fd33-4fff-baf4-f1941b8e6ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a84ccb90-fd33-4fff-baf4-f1941b8e6ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c643d6ae-db05-47e2-a1bb-0222dfb08412', 'volume_name': 'volume-c643d6ae-db05-47e2-a1bb-0222dfb08412', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1839a96-470e-4417-bf06-171142b9b295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1839a96-470e-4417-bf06-171142b9b295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8a366-2b7c-4fa0-ad5b-335039e3b542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Volume c643d6ae-db05-47e2-a1bb-0222dfb08412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c643d6ae-db05-47e2-a1bb-0222dfb08412', 'volume_size': 1} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:46 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f 1073741824" returned: 0 in 0.989s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:46 devstack sudo[93954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f Nov 05 10:57:46 devstack sudo[93954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:47 devstack sudo[93954]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f" returned: 0 in 0.311s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] <== create_volume: return (1379ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.387s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.447s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=596887dc-115f-4258-b15f-d7f509a2dd57,created_at=2026-11-05T09:57:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1167040834',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=596887dc-115f-4258-b15f-d7f509a2dd57,host='devstack@QuobyteHD#QuobyteHD',id=c643d6ae-db05-47e2-a1bb-0222dfb08412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:46Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fb9b5d8d-2d7f-4293-bce1-20f5cb494e55),volume_type_id=fb9b5d8d-2d7f-4293-bce1-20f5cb494e55)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Creating volume c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:57:47 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1550c2e-a366-4d6e-93c7-39a8ea9af0f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f95fa2d0-7629-485f-afe1-0d30d569775f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587550b4-ee7d-4a5d-b371-34c104353a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:47 devstack sudo[93959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 1073741824 Nov 05 10:57:47 devstack sudo[93959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:47 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Volume volume-f95fa2d0-7629-485f-afe1-0d30d569775f (f95fa2d0-7629-485f-afe1-0d30d569775f): created successfully Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587550b4-ee7d-4a5d-b371-34c104353a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Flow 'volume_create_manager' (7316e841-eb70-455f-8f94-744d072fd75f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7f0e81cf-7a9f-4482-8048-86ae94d63139 tempest-ServerActionsTestOtherA-1565441553 None] Created volume successfully. Nov 05 10:57:47 devstack sudo[93959]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 1073741824" returned: 0 in 0.776s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:48 devstack sudo[93966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 Nov 05 10:57:48 devstack sudo[93966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:48 devstack sudo[93966]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412" returned: 0 in 0.501s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] <== create_volume: return (1349ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.355s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09f8a366-2b7c-4fa0-ad5b-335039e3b542) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c643d6ae-db05-47e2-a1bb-0222dfb08412', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a073518d-52c7-4101-bbef-f874c8cba67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Volume volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 (c643d6ae-db05-47e2-a1bb-0222dfb08412): created successfully Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a073518d-52c7-4101-bbef-f874c8cba67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (39414282-3830-44a2-9fbc-6a4f088def40) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-65414dbd-0215-44b2-a151-52bee4a3358f tempest-GroupSnapshotsTest-1575266435 None] Created volume successfully. Nov 05 10:57:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c1dd51b3-88ac-4f83-a89b-ca344ca30d59 tempest-GroupSnapshotsTest-1575266435 None] Update group completed successfully. Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:50 devstack sudo[93984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:57:50 devstack sudo[93984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:50 devstack sudo[93984]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.415s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 9 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:57:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:57:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-547921b8-1791-47f5-b40b-c4f8baaa9af8 tempest-GroupSnapshotsTest-1575266435 None] Update group completed successfully. Nov 05 10:57:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7ee011f8-95ea-4f43-acf9-fad3c778fb9d tempest-GroupSnapshotsTest-1575266435 None] Update group completed successfully. Nov 05 10:57:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9e6c6942-44c0-43d4-89ca-679a5973a797 tempest-GroupSnapshotsTest-1575266435 None] Update group completed successfully. Nov 05 10:57:55 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] GroupSnapshot 0c9beac8-dc22-478f-be50-c420190edd12: creating. Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Group snapshot 0c9beac8-dc22-478f-be50-c420190edd12: creating. {{(pid=87369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Creating offline snapshot 07303c6b-d846-437c-8b28-03669abc114c of volume 12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d4b18d3-a72e-4e89-a182-4d1242bedd09]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:57:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:56 devstack sudo[94053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 Nov 05 10:57:56 devstack sudo[94053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:56 devstack sudo[94053]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644" returned: 0 in 0.853s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:56 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c 1G Nov 05 10:57:56 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=96,cinder:UPDATE=109,cinder:INSERT=24,cinder:DELETE=8 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=111,cinder:SELECT=105,cinder:INSERT=22,cinder:DELETE=7 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (73aa113d-05b4-4e01-bc6a-5f64fb20f795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea847a24-3054-4711-bf78-85e55b3ac7d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:57 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea847a24-3054-4711-bf78-85e55b3ac7d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1736465411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:58Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6746f7-a535-4970-9b46-9d687d852dad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6746f7-a535-4970-9b46-9d687d852dad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0726fcd-e2de-4820-9f39-d1487b167a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0726fcd-e2de-4820-9f39-d1487b167a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7', 'volume_name': 'volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19df5804-e443-4a77-b47d-2354133c6065) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19df5804-e443-4a77-b47d-2354133c6065) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5df52-658e-4ebc-a0b4-67815e06ba23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:57:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Volume 4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7', 'volume_size': 1} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c 1G" returned: 0 in 1.112s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12374447-e466-4207-85a0-683bd9b8c644 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:57 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12374447-e466-4207-85a0-683bd9b8c644 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c Nov 05 10:57:57 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:58 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-12374447-e466-4207-85a0-683bd9b8c644 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c" returned: 0 in 0.639s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:58 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:57:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:58 devstack sudo[94072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c Nov 05 10:57:58 devstack sudo[94072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:58 devstack sudo[94072]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:59 devstack sudo[94077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info Nov 05 10:57:59 devstack sudo[94077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:57:59 devstack sudo[94077]: pam_unix(sudo:session): session closed for user root Nov 05 10:57:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info" returned: 0 in 0.455s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:57:59 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:57:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:57:59 devstack sudo[94080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info Nov 05 10:57:59 devstack sudo[94080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:00 devstack sudo[94080]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.info" returned: 0 in 0.850s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.530s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Creating offline snapshot 44bfa707-d00b-4696-a3bc-5a1d59d74343 of volume c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb80acf2-0c55-4c8e-8f72-62c3b30aea0f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:00 devstack sudo[94147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 Nov 05 10:58:00 devstack sudo[94147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:01 devstack sudo[94147]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412" returned: 0 in 0.784s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:01 devstack sudo[94153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 1G Nov 05 10:58:01 devstack sudo[94153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:02 devstack sudo[94153]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 1G" returned: 0 in 0.827s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:02 devstack sudo[94163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 Nov 05 10:58:02 devstack sudo[94163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:02 devstack sudo[94163]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343" returned: 0 in 0.576s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:02 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:02 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 Nov 05 10:58:02 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:02 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343" returned: 0 in 0.308s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:03 devstack sudo[94171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info Nov 05 10:58:03 devstack sudo[94171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:03 devstack sudo[94171]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info" returned: 0 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:03 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:03 devstack sudo[94174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info Nov 05 10:58:03 devstack sudo[94174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:03 devstack sudo[94174]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.info" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.391s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.883s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:57:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1736465411',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:57:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:57:58Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Creating volume 4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:03 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:03 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 1073741824 Nov 05 10:58:03 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-785b55f8-ffdd-49af-94ac-06de8ab47077 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c9beac8-dc22-478f-be50-c420190edd12: created successfully Nov 05 10:58:04 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 1073741824" returned: 0 in 0.951s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:04 devstack sudo[94188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 Nov 05 10:58:04 devstack sudo[94188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c9beac8-dc22-478f-be50-c420190edd12: deleting Nov 05 10:58:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c9beac8-dc22-478f-be50-c420190edd12: deleting {{(pid=87369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" acquired by "delete_snapshot" :: waited 0.070s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-07303c6b-d846-437c-8b28-03669abc114c" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-07303c6b-d846-437c-8b28-03669abc114c" acquired by "_delete_snapshot" :: waited 0.049s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:05 devstack sudo[94188]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Deleting offline snapshot 07303c6b-d846-437c-8b28-03669abc114c of volume 12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] snapshot_file for this snap is: volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.503s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1949ede0-1fb7-4dd7-bd0b-21b33138d2d1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1f5df52-658e-4ebc-a0b4-67815e06ba23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cc9ce8-806c-49a6-8ac5-867dd7c5458b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:05 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Volume volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 (4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7): created successfully Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5cc9ce8-806c-49a6-8ac5-867dd7c5458b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (73aa113d-05b4-4e01-bc6a-5f64fb20f795) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-295c02c0-d3a9-48ae-905b-05b621c2d828 tempest-VolumesListAdminTestJSON-865506551 None] Created volume successfully. Nov 05 10:58:05 devstack sudo[94191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c Nov 05 10:58:05 devstack sudo[94191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:06 devstack sudo[94191]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c" returned: 0 in 0.882s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-12374447-e466-4207-85a0-683bd9b8c644(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43042c66-5e79-4e9e-9b6c-27467020c086]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:06 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 Nov 05 10:58:06 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:06 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644" returned: 0 in 0.720s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:07 devstack sudo[94204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c Nov 05 10:58:07 devstack sudo[94204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:07 devstack sudo[94204]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c" returned: 0 in 0.817s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:07 devstack sudo[94210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c Nov 05 10:58:07 devstack sudo[94210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (a0172edd-b889-4590-9895-4c0c464b6b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3b7ea7-4bbe-4d1b-b93c-dae6786eda6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3b7ea7-4bbe-4d1b-b93c-dae6786eda6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061189571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cea9a15-01d0-4be9-95f8-43f8ce0b2de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:08Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9033a689-f1b0-4797-930f-f47c339244de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9033a689-f1b0-4797-930f-f47c339244de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054dd37-f21c-4e31-8414-cc30dc192f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d054dd37-f21c-4e31-8414-cc30dc192f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cea9a15-01d0-4be9-95f8-43f8ce0b2de0', 'volume_name': 'volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a051e2-8265-4ae5-aa9a-e77a1a1a45c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77a051e2-8265-4ae5-aa9a-e77a1a1a45c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca703206-030e-4355-9f24-af3d927dc11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:07 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Volume 2cea9a15-01d0-4be9-95f8-43f8ce0b2de0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0', 'volume_size': 1} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2061189571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cea9a15-01d0-4be9-95f8-43f8ce0b2de0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:08Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Creating volume 2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:07 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:07 devstack sudo[94212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 1073741824 Nov 05 10:58:07 devstack sudo[94212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:08 devstack sudo[94210]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644.07303c6b-d846-437c-8b28-03669abc114c" returned: 0 in 0.437s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-07303c6b-d846-437c-8b28-03669abc114c" released by "_delete_snapshot" :: held 3.101s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" released by "delete_snapshot" :: held 3.172s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-44bfa707-d00b-4696-a3bc-5a1d59d74343" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-44bfa707-d00b-4696-a3bc-5a1d59d74343" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Deleting offline snapshot 44bfa707-d00b-4696-a3bc-5a1d59d74343 of volume c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] snapshot_file for this snap is: volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad85ff8-6afe-4703-bd51-de826bc39240]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:08 devstack sudo[94219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 Nov 05 10:58:08 devstack sudo[94219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:08 devstack sudo[94212]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 1073741824" returned: 0 in 0.654s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:08 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 Nov 05 10:58:08 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:09 devstack sudo[94219]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343" returned: 0 in 0.622s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c643d6ae-db05-47e2-a1bb-0222dfb08412(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c1b69e-7bbb-44a0-a1ff-aff645ac64b2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:09 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] <== create_volume: return (1307ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca703206-030e-4355-9f24-af3d927dc11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54423455-a648-4d34-99b5-3259dc2069dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:09 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 Nov 05 10:58:09 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:09 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Volume volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 (2cea9a15-01d0-4be9-95f8-43f8ce0b2de0): created successfully Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54423455-a648-4d34-99b5-3259dc2069dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (a0172edd-b889-4590-9895-4c0c464b6b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4db019c7-2d8f-427f-b10d-c8cb959524cf tempest-VolumesListAdminTestJSON-865506551 None] Created volume successfully. Nov 05 10:58:09 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412" returned: 0 in 0.526s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:09 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 Nov 05 10:58:09 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:10 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343" returned: 0 in 0.430s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:10 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343 Nov 05 10:58:10 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:10 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412.44bfa707-d00b-4696-a3bc-5a1d59d74343" returned: 0 in 0.351s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-44bfa707-d00b-4696-a3bc-5a1d59d74343" released by "_delete_snapshot" :: held 2.091s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" released by "delete_snapshot" :: held 2.123s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (57bd461e-0ac4-4d03-b15d-533f200f60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3f8a6d-38a0-4d4f-8a27-ed7cd713936b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c3f8a6d-38a0-4d4f-8a27-ed7cd713936b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549741478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848935b1-bb66-4424-937d-1b665bebd075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:10Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0136cb64-5b3a-48d5-92f7-da7b9aa43943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0136cb64-5b3a-48d5-92f7-da7b9aa43943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a40ca0e-162f-41c5-92cf-a6b226ad692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a40ca0e-162f-41c5-92cf-a6b226ad692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '848935b1-bb66-4424-937d-1b665bebd075', 'volume_name': 'volume-848935b1-bb66-4424-937d-1b665bebd075', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c733c66-d52a-424a-b147-0bce6fe2c329) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c733c66-d52a-424a-b147-0bce6fe2c329) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201c39c7-388a-494f-b8ea-0856de6a9066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:10 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Volume 848935b1-bb66-4424-937d-1b665bebd075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-848935b1-bb66-4424-937d-1b665bebd075', 'volume_size': 1} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-549741478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=848935b1-bb66-4424-937d-1b665bebd075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c5aaab6de4124f449799b88f752d9d18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:10Z,use_quota=True,user_id='cc5153a9934a4d6596188dd09ac5126c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Creating volume 848935b1-bb66-4424-937d-1b665bebd075 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:10 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:10 devstack cinder-volume[87369]: WARNING cinder.quota [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-283876675 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-283876675, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:10 devstack cinder-volume[87369]: WARNING cinder.quota [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-283876675 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-283876675, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:10 devstack sudo[94269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 1073741824 Nov 05 10:58:10 devstack sudo[94269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['2cb3a864-7698-4a63-be55-5e8c70e942ba', '70430a80-50a6-4240-9a8b-9194e444c97f', '3d8735b0-650d-48fa-9143-e3acb8c29777', '9b604b8a-91a0-4959-aa21-4a0a882cbe26'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['09624c9f-8729-498f-a44c-69fda2535c9b', 'ca04cea0-d062-4444-8419-08c72e4275a7', '333faef6-ac77-45f5-b39b-26e6aa2da3de', '036feaa9-74e5-41de-9288-e02d4c80fee4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-60c63d26-1f9d-406f-b26e-7fde4e64ef34 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c9beac8-dc22-478f-be50-c420190edd12: deleted successfully Nov 05 10:58:11 devstack sudo[94269]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 1073741824" returned: 0 in 0.537s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:11 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 Nov 05 10:58:11 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:11 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (201c39c7-388a-494f-b8ea-0856de6a9066) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-848935b1-bb66-4424-937d-1b665bebd075', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b929c33-8e5e-4b2c-900d-8e5a3cc9a657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:11 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Volume volume-848935b1-bb66-4424-937d-1b665bebd075 (848935b1-bb66-4424-937d-1b665bebd075): created successfully Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b929c33-8e5e-4b2c-900d-8e5a3cc9a657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Flow 'volume_create_manager' (57bd461e-0ac4-4d03-b15d-533f200f60d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3d6b24c-9577-4317-ac16-5d4f0ac4ebcb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2d6f7516-dfee-4411-962e-60a6f1fde863 tempest-VolumesListAdminTestJSON-865506551 None] Created volume successfully. Nov 05 10:58:11 devstack sudo[94278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 Nov 05 10:58:11 devstack sudo[94278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:12 devstack sudo[94278]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644" returned: 0 in 0.429s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:12 devstack sudo[94284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644 Nov 05 10:58:12 devstack sudo[94284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:12 devstack sudo[94284]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-12374447-e466-4207-85a0-683bd9b8c644" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-12374447-e466-4207-85a0-683bd9b8c644" released by "delete_volume" :: held 0.831s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3419cfe-4a8d-46ad-a179-72f5cb6c9e3e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:12 devstack sudo[94287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 Nov 05 10:58:12 devstack sudo[94287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:13 devstack sudo[94287]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412" returned: 0 in 0.588s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:13 devstack sudo[94292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412 Nov 05 10:58:13 devstack sudo[94292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:13 devstack sudo[94292]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c643d6ae-db05-47e2-a1bb-0222dfb08412" returned: 0 in 0.309s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-c643d6ae-db05-47e2-a1bb-0222dfb08412" released by "delete_volume" :: held 0.980s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Flow 'volume_create_manager' (713d4a75-33cc-4eb4-8af6-57c73f9d3ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178cec30-b610-43e9-b5f1-dcf0e2c591ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (178cec30-b610-43e9-b5f1-dcf0e2c591ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44211e7-7f72-4d91-ac5b-c21ab8fb9a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6523fbf31aae442a88ed79fb4bd85ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:13Z,use_quota=True,user_id='76cdf19cb052442dbbdf3ef04ea573ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c340a-cc80-4c3a-a443-23572a8daccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a07c340a-cc80-4c3a-a443-23572a8daccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34adda5-1e80-4e1a-80ec-7468447f9ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34adda5-1e80-4e1a-80ec-7468447f9ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44211e7-7f72-4d91-ac5b-c21ab8fb9a76', 'volume_name': 'volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a0b474-dce7-4e89-881c-1392da1cf707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a0b474-dce7-4e89-881c-1392da1cf707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e22594-f826-44e8-9c0c-7b7354adab03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:13 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Volume c44211e7-7f72-4d91-ac5b-c21ab8fb9a76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76', 'volume_size': 1} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:13Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44211e7-7f72-4d91-ac5b-c21ab8fb9a76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6523fbf31aae442a88ed79fb4bd85ad9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:13Z,use_quota=True,user_id='76cdf19cb052442dbbdf3ef04ea573ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Creating volume c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:13 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['9be33b93-5791-4eb7-afcf-1ba455f186bc'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:13 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 1073741824 Nov 05 10:58:13 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:13 devstack cinder-volume[87369]: WARNING cinder.quota [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-283876675 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-283876675, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['d9245e5e-2e93-449f-a13c-20f1d36eb5c2', 'fe5b3f40-8c48-4670-9fd1-a849bed13a2f', '46499ba8-aa6c-411b-aa2c-5cb194a7ed2b', 'a0f4b8ea-0af7-4a95-926b-902bca6114fd'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['bdafdbb3-01f8-4b6e-88df-6f9c9d16a93e', '4d30eb31-91d9-484b-8a1a-5d62fd59376c', '3db2f36b-d890-40aa-8e80-c37124b2b22c', '05200de2-4e7c-4eb0-b7e9-5ffeb51dec45'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:14 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:14 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:14 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 1073741824" returned: 0 in 0.634s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:14 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 Nov 05 10:58:14 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:14 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.376s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-87a0efca-5c27-45e0-8894-9ea94afb51ae tempest-GroupSnapshotsTest-1575266435 None] Delete group completed successfully. Nov 05 10:58:14 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" returned: 0 in 0.371s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4e22594-f826-44e8-9c0c-7b7354adab03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e20963-e06d-4a37-9dff-b688916f9a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Volume volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 (c44211e7-7f72-4d91-ac5b-c21ab8fb9a76): created successfully Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02e20963-e06d-4a37-9dff-b688916f9a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Flow 'volume_create_manager' (713d4a75-33cc-4eb4-8af6-57c73f9d3ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2bba6e4d-a01a-4b40-b9c0-fbad8eed12b0 tempest-VolumesListAdminTestJSON-2119132748 None] Created volume successfully. Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bca1d954-943b-4e52-8d1d-5a0a514b9ca2 tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-1189028618: creating Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bca1d954-943b-4e52-8d1d-5a0a514b9ca2 tempest-GroupSnapshotsTest-1575266435 None] Group tempest-GroupSnapshotsTest-Group-1189028618: created successfully Nov 05 10:58:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bca1d954-943b-4e52-8d1d-5a0a514b9ca2 tempest-GroupSnapshotsTest-1575266435 None] Create group completed successfully. Nov 05 10:58:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Acquiring lock "cinder-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "cinder-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Acquiring lock "cinder-quobyte-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-848935b1-bb66-4424-937d-1b665bebd075-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "cinder-quobyte-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" acquired by "delete_volume" :: waited 0.070s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-848935b1-bb66-4424-937d-1b665bebd075-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7692401b-1509-496e-b296-500d1bf28757]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-quobyte-848935b1-bb66-4424-937d-1b665bebd075" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-848935b1-bb66-4424-937d-1b665bebd075" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[27b2fdbb-ace7-4ad4-a3f3-495db26c95b8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:16 devstack sudo[94363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 Nov 05 10:58:16 devstack sudo[94363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:16 devstack sudo[94369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 Nov 05 10:58:16 devstack sudo[94369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:16 devstack sudo[94363]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" returned: 0 in 0.624s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:16 devstack sudo[94379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76 Nov 05 10:58:16 devstack sudo[94379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:17 devstack sudo[94369]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075" returned: 0 in 1.068s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:17 devstack sudo[94421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075 Nov 05 10:58:17 devstack sudo[94421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (21dae81d-a58a-421d-9aa3-848e5e1494ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fded39-ae3b-4bfe-9867-fd269d4faf90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26fded39-ae3b-4bfe-9867-fd269d4faf90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295455044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3a2002b-0537-45ad-b087-e792e3214bdc,host='devstack@QuobyteHD#QuobyteHD',id=37f794bf-5874-4efd-92a7-497718da4f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:17Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54361852-e678-4ce8-95a8-44049a970f66),volume_type_id=54361852-e678-4ce8-95a8-44049a970f66)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280ba850-f313-4986-9ee1-ff4ec7e9d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (280ba850-f313-4986-9ee1-ff4ec7e9d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb65902-c1a6-4260-91eb-0acd540e52ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcb65902-c1a6-4260-91eb-0acd540e52ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37f794bf-5874-4efd-92a7-497718da4f21', 'volume_name': 'volume-37f794bf-5874-4efd-92a7-497718da4f21', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac7eb84-1bdf-4bc2-aa03-564f5be973de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ac7eb84-1bdf-4bc2-aa03-564f5be973de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:17 devstack sudo[94379]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357928c1-2c8c-4f86-8c6e-3e339e054355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Volume 37f794bf-5874-4efd-92a7-497718da4f21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37f794bf-5874-4efd-92a7-497718da4f21', 'volume_size': 1} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=c3a2002b-0537-45ad-b087-e792e3214bdc,created_at=2026-11-05T09:58:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295455044',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=c3a2002b-0537-45ad-b087-e792e3214bdc,host='devstack@QuobyteHD#QuobyteHD',id=37f794bf-5874-4efd-92a7-497718da4f21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f8598876c154340b12ccd9d55e71795',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:17Z,use_quota=True,user_id='285103c6643d4b6dbeb7fbd5e22f3401',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(54361852-e678-4ce8-95a8-44049a970f66),volume_type_id=54361852-e678-4ce8-95a8-44049a970f66)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Creating volume 37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:17 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" returned: 0 in 0.791s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:17 devstack sudo[94424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 1073741824 Nov 05 10:58:17 devstack sudo[94424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "cinder-quobyte-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76" released by "delete_volume" :: held 1.606s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Created reservations ['fe259780-2d54-466a-a732-e16df531dad4', 'e6144742-589d-4f19-a481-9c9edf45ba2b', 'fba319b7-6319-4d63-ab62-8e53db02f095', 'b50fe1ed-650e-47db-bcf3-c32aec780775'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:17 devstack sudo[94421]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-848935b1-bb66-4424-937d-1b665bebd075" returned: 0 in 0.442s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-848935b1-bb66-4424-937d-1b665bebd075" released by "delete_volume" :: held 1.597s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:17 devstack sudo[94427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:17 devstack sudo[94427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:17 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Created reservations ['e4536eca-6845-4fee-93f3-8ec06b14ce8b', 'b7023eba-2a64-4655-a090-bfc9ff7c54e1', 'efc9b97b-8edf-4d5a-9b08-58d5533d444a', '0780736d-3577-42fc-8474-c461c3cb1df2'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:18 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:18 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:18 devstack sudo[94427]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.372s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Deleted volume successfully. Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-577c50d4-6109-4d62-9e16-811008f11a73 tempest-VolumesListAdminTestJSON-2119132748 None] Lock "cinder-c44211e7-7f72-4d91-ac5b-c21ab8fb9a76-delete_volume" released by "delete_volume" :: held 2.435s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:18 devstack sudo[94424]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 1073741824" returned: 0 in 0.695s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:18 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 Nov 05 10:58:18 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:18 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Deleted volume successfully. Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc984c22-208a-43ac-8ff5-4100f9337250 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-848935b1-bb66-4424-937d-1b665bebd075-delete_volume" released by "delete_volume" :: held 2.350s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-quobyte-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004e6d6-d3fd-4bd1-8c0c-09976b13ea37]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:18 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21" returned: 0 in 0.303s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] <== create_volume: return (1049ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (357928c1-2c8c-4f86-8c6e-3e339e054355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37f794bf-5874-4efd-92a7-497718da4f21', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fbc8e2-02da-4db6-8b24-bc1bcca04d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Volume volume-37f794bf-5874-4efd-92a7-497718da4f21 (37f794bf-5874-4efd-92a7-497718da4f21): created successfully Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (72fbc8e2-02da-4db6-8b24-bc1bcca04d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Flow 'volume_create_manager' (21dae81d-a58a-421d-9aa3-848e5e1494ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3ede27a5-8c14-4603-861d-01afd5d07cff tempest-GroupSnapshotsTest-1575266435 None] Created volume successfully. Nov 05 10:58:18 devstack sudo[94441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 Nov 05 10:58:18 devstack sudo[94441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:19 devstack sudo[94441]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:19 devstack sudo[94449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0 Nov 05 10:58:19 devstack sudo[94449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:19 devstack sudo[94449]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" returned: 0 in 0.384s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0" released by "delete_volume" :: held 0.855s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Created reservations ['9ae18740-1e33-49e4-b13c-13e746554789', '4d30f0e9-bcd9-44ff-8868-6076e3e24b94', '6a27f48a-909e-4781-afb3-e4c35dc8efcd', '7da49152-3bb8-4695-bdd7-7231b5f55266'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:19 devstack sudo[94474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:19 devstack sudo[94474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "cinder-quobyte-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa72c8a5-5fd1-4381-9806-a3a04dc5fb86]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:20 devstack sudo[94474]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.393s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Deleted volume successfully. Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3cc8b936-b7c2-41a0-8b1c-d18049441f93 tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-2cea9a15-01d0-4be9-95f8-43f8ce0b2de0-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:20 devstack sudo[94477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 Nov 05 10:58:20 devstack sudo[94477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] GroupSnapshot 0c889541-eae4-4d07-bc05-e4db878bb342: creating. Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Group snapshot 0c889541-eae4-4d07-bc05-e4db878bb342: creating. {{(pid=87369) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Creating offline snapshot 506fb58d-f849-425d-978a-b9d924ff809d of volume 37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07c79ed-d61c-4f1f-a270-7e6caf5b609a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:20 devstack sudo[94477]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" returned: 0 in 0.597s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:20 devstack sudo[94484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7 Nov 05 10:58:20 devstack sudo[94484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:20 devstack sudo[94483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 Nov 05 10:58:20 devstack sudo[94483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:20 devstack sudo[94484]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" returned: 0 in 0.338s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-quobyte-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7" released by "delete_volume" :: held 1.015s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:21 devstack sudo[94483]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21" returned: 0 in 0.535s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Created reservations ['cd5f26ab-7567-45eb-a432-7e692b3be89c', 'f14bb1d9-397f-4f8e-a952-2b76ca390d27', 'c3ca981b-69e9-4524-b635-9b1d2d0a9f43', '103c6620-733d-4b19-9a0a-4a2ac15d08b5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:21 devstack sudo[94493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d 1G Nov 05 10:58:21 devstack sudo[94493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:21 devstack sudo[94495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:21 devstack sudo[94495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:21 devstack sudo[94495]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.305s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Deleted volume successfully. Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9abaa33a-70ff-4ae9-bb3a-8383eea2f47d tempest-VolumesListAdminTestJSON-865506551 None] Lock "cinder-4acfd5c0-0f5a-4a8c-be5b-a98f3dc448c7-delete_volume" released by "delete_volume" :: held 1.711s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:21 devstack sudo[94493]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d 1G" returned: 0 in 0.636s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f794bf-5874-4efd-92a7-497718da4f21 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:21 devstack sudo[94502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f794bf-5874-4efd-92a7-497718da4f21 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d Nov 05 10:58:21 devstack sudo[94502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:22 devstack sudo[94502]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-37f794bf-5874-4efd-92a7-497718da4f21 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d" returned: 0 in 0.348s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:22 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:22 devstack sudo[94507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d Nov 05 10:58:22 devstack sudo[94507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:22 devstack sudo[94507]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:22 devstack sudo[94510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info Nov 05 10:58:22 devstack sudo[94510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:22 devstack sudo[94510]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:22 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:22 devstack sudo[94513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info Nov 05 10:58:22 devstack sudo[94513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:22 devstack sudo[94513]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.info" returned: 0 in 0.292s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.441s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-730905a3-642d-4fdf-a6df-d7f119c0d75c tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c889541-eae4-4d07-bc05-e4db878bb342: created successfully Nov 05 10:58:23 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c889541-eae4-4d07-bc05-e4db878bb342: deleting Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c889541-eae4-4d07-bc05-e4db878bb342: deleting {{(pid=87369) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-506fb58d-f849-425d-978a-b9d924ff809d" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-506fb58d-f849-425d-978a-b9d924ff809d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Deleting offline snapshot 506fb58d-f849-425d-978a-b9d924ff809d of volume 37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] snapshot_file for this snap is: volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[05542690-fcfc-44c4-8f0a-6d59341d1ad6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:24 devstack sudo[94516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d Nov 05 10:58:24 devstack sudo[94516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:24 devstack sudo[94516]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d" returned: 0 in 0.509s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-37f794bf-5874-4efd-92a7-497718da4f21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fecba0a-16bb-4670-a8a3-0d92dc8a785c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:24 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 Nov 05 10:58:24 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-3ad5051f-346e-45f8-ac5a-3917d0c9335c req-54cf4553-8692-43b4-a7ff-f6f59cee307b tempest-AttachVolumeNegativeTest-2110355174 None] Terminate volume connection completed successfully. Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-3ad5051f-346e-45f8-ac5a-3917d0c9335c req-54cf4553-8692-43b4-a7ff-f6f59cee307b tempest-AttachVolumeNegativeTest-2110355174 None] Deleting attachment a1fe6e88-cd59-43ac-94f4-ceaea28fca11. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:58:24 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21" returned: 0 in 0.453s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:25 devstack sudo[94530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d Nov 05 10:58:25 devstack sudo[94530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:25 devstack sudo[94530]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d" returned: 0 in 0.510s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:25 devstack sudo[94535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d Nov 05 10:58:25 devstack sudo[94535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:25 devstack sudo[94535]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21.506fb58d-f849-425d-978a-b9d924ff809d" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-506fb58d-f849-425d-978a-b9d924ff809d" released by "_delete_snapshot" :: held 1.978s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" released by "delete_snapshot" :: held 2.032s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:26 devstack cinder-volume[87369]: WARNING cinder.quota [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1715286101 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1715286101, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:26 devstack cinder-volume[87369]: WARNING cinder.quota [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1715286101 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1715286101, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:26 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['0b31c6cb-d460-4cce-af4d-ccb449adf0ff', '3bd5ac4d-ebcb-44e8-bd3a-16783b7c927e', '9861b426-6ccb-428c-b08f-b0b8d881a308', '3da9acfe-12bc-4b62-8809-efdfa69d87c5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-80781de7-6dc7-4a35-ad16-d226489af577 tempest-GroupSnapshotsTest-1575266435 None] group_snapshot 0c889541-eae4-4d07-bc05-e4db878bb342: deleted successfully Nov 05 10:58:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:27 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e198c780-c566-453a-8bb9-f9794b0b2c87]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:28 devstack sudo[94562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 Nov 05 10:58:28 devstack sudo[94562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:28 devstack sudo[94562]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21" returned: 0 in 0.504s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:28 devstack sudo[94568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21 Nov 05 10:58:28 devstack sudo[94568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:28 devstack sudo[94568]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-37f794bf-5874-4efd-92a7-497718da4f21" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Lock "cinder-quobyte-37f794bf-5874-4efd-92a7-497718da4f21" released by "delete_volume" :: held 0.977s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['0a9f4f53-31b2-410e-8f6b-f9218dcc46f1'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:28 devstack cinder-volume[87369]: WARNING cinder.quota [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1715286101 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1715286101, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:58:28 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Created reservations ['7e4ff12e-9183-49fe-bbea-89aee332c729', 'f85a4d5f-4224-4620-a057-866e29a5bdf0', '1bf4c6d9-35c1-4ae5-a810-13678aff5099', '792a977c-8040-491c-9c57-100351fa6918'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:29 devstack sudo[94573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:29 devstack sudo[94573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:29 devstack sudo[94573]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0e31ce2e-ba7d-4a39-87b5-9a3a8f60e84d tempest-GroupSnapshotsTest-1575266435 None] Delete group completed successfully. Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Flow 'volume_create_manager' (18ceaba8-20a8-4d27-aa8e-12c885964e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f133b8-20f7-406f-9ed2-2d95999f84e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97f133b8-20f7-406f-9ed2-2d95999f84e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1213934652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cea911-4a2e-4a00-819f-347a1d9d316f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba6074bc81e42b396593fa1996e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:30Z,use_quota=True,user_id='eeac73cae970452cbde1db0f4537deb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffee6bd-5825-469b-b060-0ce962b1e5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bffee6bd-5825-469b-b060-0ce962b1e5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96d2411-1b11-41f7-97d1-e35bad00b03e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:29 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b96d2411-1b11-41f7-97d1-e35bad00b03e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '77cea911-4a2e-4a00-819f-347a1d9d316f', 'volume_name': 'volume-77cea911-4a2e-4a00-819f-347a1d9d316f', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049082b7-a427-4da8-abb8-ea7d7cb43cb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049082b7-a427-4da8-abb8-ea7d7cb43cb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b40c917-dc05-4e58-a556-fabb88c2f94b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Volume 77cea911-4a2e-4a00-819f-347a1d9d316f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-77cea911-4a2e-4a00-819f-347a1d9d316f', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Trying to clone 77cea911-4a2e-4a00-819f-347a1d9d316f from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 10:58:30 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Image download 20.69 MB at 20.69 MB/s Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-2c715a11-3fdd-4183-8762-e349cb4f14da req-66f14031-74ae-40c8-93c1-899a0689a39e tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-2c715a11-3fdd-4183-8762-e349cb4f14da req-66f14031-74ae-40c8-93c1-899a0689a39e tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-2c715a11-3fdd-4183-8762-e349cb4f14da req-66f14031-74ae-40c8-93c1-899a0689a39e tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fc9b86-3352-4e09-80a4-5aec2b749d3f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-2c715a11-3fdd-4183-8762-e349cb4f14da req-66f14031-74ae-40c8-93c1-899a0689a39e tempest-ServerActionsTestOtherA-1565441553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-f95fa2d0-7629-485f-afe1-0d30d569775f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ebb2b212-fa67-4638-9375-f9ff4a55a0f9', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:58:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-2c715a11-3fdd-4183-8762-e349cb4f14da req-66f14031-74ae-40c8-93c1-899a0689a39e tempest-ServerActionsTestOtherA-1565441553 None] attachment_update completed successfully. Nov 05 10:58:31 devstack sudo[94610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD Nov 05 10:58:31 devstack sudo[94610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:31 devstack sudo[94610]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD" returned: 0 in 0.520s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:31 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae is fetched for user eeac73cae970452cbde1db0f4537deb6. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 10:58:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b632f029-1c86-43b2-a545-a109cf80310d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:31 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD Nov 05 10:58:31 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:32 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD" returned: 0 in 0.489s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1213934652',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77cea911-4a2e-4a00-819f-347a1d9d316f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ba6074bc81e42b396593fa1996e0367',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:30Z,use_quota=True,user_id='eeac73cae970452cbde1db0f4537deb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Creating volume 77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:32 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:32 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1073741824 Nov 05 10:58:32 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:32 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1073741824" returned: 0 in 0.724s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:32 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f Nov 05 10:58:32 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:33 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Attempting download of d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 77cea911-4a2e-4a00-819f-347a1d9d316f. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f3020ee-d86a-4a63-ae72-6a1c42de0dcf]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:33 devstack sudo[95044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27 Nov 05 10:58:33 devstack sudo[95044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:33 devstack sudo[95044]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:33 devstack sudo[95048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27 Nov 05 10:58:33 devstack sudo[95048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:34 devstack sudo[95048]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27" returned: 1 in 0.417s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_5y6x5a27' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc8ee45-fe21-418f-85d9-68e11bc7a240]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:34 devstack sudo[95052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD Nov 05 10:58:34 devstack sudo[95052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:34 devstack sudo[95052]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD" returned: 0 in 0.573s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] d8cb4abc-43bb-420e-94aa-12ceb67e37ae was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 10:58:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:34 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f Nov 05 10:58:34 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c22725ee-947b-45b7-bff8-45e156171905 tempest-ServerActionsTestOtherA-1565441553 None] Terminate volume connection completed successfully. Nov 05 10:58:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c22725ee-947b-45b7-bff8-45e156171905 tempest-ServerActionsTestOtherA-1565441553 None] Deleting attachment ebb2b212-fa67-4638-9375-f9ff4a55a0f9. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:58:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c093ca24-57c9-4f44-b107-92be76ef4c14 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c093ca24-57c9-4f44-b107-92be76ef4c14 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c093ca24-57c9-4f44-b107-92be76ef4c14 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c093ca24-57c9-4f44-b107-92be76ef4c14 tempest-ServerActionsTestOtherA-1565441553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-f95fa2d0-7629-485f-afe1-0d30d569775f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c1bcae6-c3ba-47dd-a244-4195d6a34d4e', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:58:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-bc240065-13c6-4b52-bf29-259af348cb1f req-c093ca24-57c9-4f44-b107-92be76ef4c14 tempest-ServerActionsTestOtherA-1565441553 None] attachment_update completed successfully. Nov 05 10:58:38 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f" returned: 0 in 3.366s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_y42tkci0devstack@QuobyteHD, size 112.00 MB, duration 3.37 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 10:58:38 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Converted 112.00 MB image at 33.26 MB/s Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:38 devstack sudo[95136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1G Nov 05 10:58:38 devstack sudo[95136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:38 devstack sudo[95136]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f 1G" returned: 0 in 0.496s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Downloaded image d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 77cea911-4a2e-4a00-819f-347a1d9d316f successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae for user eeac73cae970452cbde1db0f4537deb6 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Marking volume 77cea911-4a2e-4a00-819f-347a1d9d316f as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Copying metadata from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae to 77cea911-4a2e-4a00-819f-347a1d9d316f. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Creating volume glance metadata for volume 77cea911-4a2e-4a00-819f-347a1d9d316f backed by image d8cb4abc-43bb-420e-94aa-12ceb67e37ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b40c917-dc05-4e58-a556-fabb88c2f94b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77cea911-4a2e-4a00-819f-347a1d9d316f', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac840045-0ac8-4dff-84b1-3d95c45205de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:38 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Volume volume-77cea911-4a2e-4a00-819f-347a1d9d316f (77cea911-4a2e-4a00-819f-347a1d9d316f): created successfully Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac840045-0ac8-4dff-84b1-3d95c45205de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Flow 'volume_create_manager' (18ceaba8-20a8-4d27-aa8e-12c885964e42) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:38 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ed4acb6a-3293-4bf5-a84f-aaddae3be6ff tempest-VolumesImageMetadata-673270119 None] Created volume successfully. Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Acquiring lock "cinder-77cea911-4a2e-4a00-819f-347a1d9d316f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "cinder-77cea911-4a2e-4a00-819f-347a1d9d316f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Acquiring lock "cinder-quobyte-77cea911-4a2e-4a00-819f-347a1d9d316f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "cinder-quobyte-77cea911-4a2e-4a00-819f-347a1d9d316f" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e40af7-739c-41a6-8fb4-1838c6557660]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:40 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f Nov 05 10:58:40 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:41 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f" returned: 0 in 0.610s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:41 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f Nov 05 10:58:41 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:41 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-77cea911-4a2e-4a00-819f-347a1d9d316f" returned: 0 in 0.506s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "cinder-quobyte-77cea911-4a2e-4a00-819f-347a1d9d316f" released by "delete_volume" :: held 1.199s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Created reservations ['4a8282a8-2846-4bbe-816e-39e8a02d7f05', '336ec94c-1f3b-4055-b1ef-6f1bf27c5175', 'ff184cb2-30c4-418e-ab9c-22c29d0c871d', 'f626761a-6544-4400-b019-3662c1298b74'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:42 devstack sudo[95655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:42 devstack sudo[95655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:43 devstack sudo[95655]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.769s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:43 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Deleted volume successfully. Nov 05 10:58:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a9945c1d-f480-4baf-9877-e5d010188cec tempest-VolumesImageMetadata-673270119 None] Lock "cinder-77cea911-4a2e-4a00-819f-347a1d9d316f-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:50 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:50 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:51 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.838s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:51 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:58:51 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:58:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:58:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:58:52 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=114,cinder:INSERT=33,cinder:UPDATE=112,cinder:DELETE=6 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:58:53 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=111,cinder:UPDATE=121,cinder:INSERT=35,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Flow 'volume_create_manager' (5d7c4181-868e-451e-844d-e06b2d7f0f3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd213eb-4410-43b4-a134-bad096e66310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bd213eb-4410-43b4-a134-bad096e66310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1552442506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9748d43-a3e5-4046-ac07-3539d074f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49d49155b9b48e2a98b518acc740d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:54Z,use_quota=True,user_id='ff4e6ceb69584043bac7220c7879399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82078c9d-9731-40c8-bbfd-c3032c37b050) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82078c9d-9731-40c8-bbfd-c3032c37b050) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea937bb-e513-4587-8a0c-b7f313e8cbc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eea937bb-e513-4587-8a0c-b7f313e8cbc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9748d43-a3e5-4046-ac07-3539d074f040', 'volume_name': 'volume-c9748d43-a3e5-4046-ac07-3539d074f040', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01532cab-b24b-47d2-b429-b9ebd0975ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01532cab-b24b-47d2-b429-b9ebd0975ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9ad952-f89b-482b-812c-9e848bf3d408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Volume c9748d43-a3e5-4046-ac07-3539d074f040: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9748d43-a3e5-4046-ac07-3539d074f040', 'volume_size': 1} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1552442506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9748d43-a3e5-4046-ac07-3539d074f040,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49d49155b9b48e2a98b518acc740d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:58:54Z,use_quota=True,user_id='ff4e6ceb69584043bac7220c7879399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Creating volume c9748d43-a3e5-4046-ac07-3539d074f040 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:58:54 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:54 devstack sudo[95737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 1073741824 Nov 05 10:58:54 devstack sudo[95737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:54 devstack sudo[95737]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 1073741824" returned: 0 in 0.688s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:55 devstack sudo[95743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 Nov 05 10:58:55 devstack sudo[95743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:55 devstack sudo[95743]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040" returned: 0 in 0.370s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b9ad952-f89b-482b-812c-9e848bf3d408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9748d43-a3e5-4046-ac07-3539d074f040', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a263b8-d924-4046-bb5c-777f69539f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:58:55 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Volume volume-c9748d43-a3e5-4046-ac07-3539d074f040 (c9748d43-a3e5-4046-ac07-3539d074f040): created successfully Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0a263b8-d924-4046-bb5c-777f69539f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:58:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Flow 'volume_create_manager' (5d7c4181-868e-451e-844d-e06b2d7f0f3c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:58:55 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9028756b-eb32-4147-bd4b-7aff0c58787b tempest-VolumesTransfersTest-830366072 None] Created volume successfully. Nov 05 10:58:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c34f34ac-5a14-4558-8b00-438ec20b73a7 tempest-VolumesTransfersTest-2019382265 None] Transfer volume completed successfully. Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "cinder-c9748d43-a3e5-4046-ac07-3539d074f040-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-c9748d43-a3e5-4046-ac07-3539d074f040-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "cinder-quobyte-c9748d43-a3e5-4046-ac07-3539d074f040" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-quobyte-c9748d43-a3e5-4046-ac07-3539d074f040" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[301f6075-673c-4265-bfad-c9b1f0bf6068]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:58:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:58 devstack sudo[95793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 Nov 05 10:58:58 devstack sudo[95793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:59 devstack sudo[95793]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040" returned: 0 in 0.489s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:59 devstack sudo[95822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040 Nov 05 10:58:59 devstack sudo[95822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:58:59 devstack sudo[95822]: pam_unix(sudo:session): session closed for user root Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c9748d43-a3e5-4046-ac07-3539d074f040" returned: 0 in 0.329s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-quobyte-c9748d43-a3e5-4046-ac07-3539d074f040" released by "delete_volume" :: held 0.875s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Created reservations ['7f60f5a0-e4ec-4105-baf5-6a4fda7b3dcf', '6afc9b98-7c5c-4129-a753-4a5b8da81c2a', '540a7e17-30f5-4151-a122-ea5c8f153245', '2d0c6fd3-d695-40c1-856a-54260f59dfe3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:58:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:58:59 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:58:59 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:00 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.456s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Deleted volume successfully. Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ca7cefef-8d41-4cce-8514-f5c111709365 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-c9748d43-a3e5-4046-ac07-3539d074f040-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Flow 'volume_create_manager' (a9658d2c-8eb7-4ac6-a125-64e0cd351c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fdeee2-4d9d-46fa-b877-f3938f77c77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99fdeee2-4d9d-46fa-b877-f3938f77c77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2095304557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e27b9a2-6cfd-46cd-a497-d8a295812c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49d49155b9b48e2a98b518acc740d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:01Z,use_quota=True,user_id='ff4e6ceb69584043bac7220c7879399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2312f78f-973c-41e0-b23d-ba6c8fc0dc85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2312f78f-973c-41e0-b23d-ba6c8fc0dc85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d71cb0-d263-491e-af78-687069e4df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d71cb0-d263-491e-af78-687069e4df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7e27b9a2-6cfd-46cd-a497-d8a295812c26', 'volume_name': 'volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e1143-6d11-4d4a-b111-550d4e1221d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e1143-6d11-4d4a-b111-550d4e1221d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c152768-6b75-48b0-b8bc-6a59559d13cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Volume 7e27b9a2-6cfd-46cd-a497-d8a295812c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26', 'volume_size': 1} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2095304557',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e27b9a2-6cfd-46cd-a497-d8a295812c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d49d49155b9b48e2a98b518acc740d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:01Z,use_quota=True,user_id='ff4e6ceb69584043bac7220c7879399b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Creating volume 7e27b9a2-6cfd-46cd-a497-d8a295812c26 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:00 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:00 devstack sudo[95828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 1073741824 Nov 05 10:59:00 devstack sudo[95828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:01 devstack sudo[95828]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 1073741824" returned: 0 in 0.629s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:01 devstack sudo[95853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 Nov 05 10:59:01 devstack sudo[95853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:01 devstack sudo[95853]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26" returned: 0 in 0.341s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c152768-6b75-48b0-b8bc-6a59559d13cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7393e36a-466f-46f5-a73c-4231af105355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:02 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Volume volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 (7e27b9a2-6cfd-46cd-a497-d8a295812c26): created successfully Nov 05 10:59:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7393e36a-466f-46f5-a73c-4231af105355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Flow 'volume_create_manager' (a9658d2c-8eb7-4ac6-a125-64e0cd351c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-41604b6f-bd69-4055-b36f-fdd517a78414 tempest-VolumesTransfersTest-830366072 None] Created volume successfully. Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "cinder-7e27b9a2-6cfd-46cd-a497-d8a295812c26-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-7e27b9a2-6cfd-46cd-a497-d8a295812c26-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "cinder-quobyte-7e27b9a2-6cfd-46cd-a497-d8a295812c26" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-quobyte-7e27b9a2-6cfd-46cd-a497-d8a295812c26" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0fada2-fdb9-488d-b22f-4009689245d3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:03 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 Nov 05 10:59:03 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:03 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:03 devstack sudo[95861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26 Nov 05 10:59:03 devstack sudo[95861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:04 devstack sudo[95861]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7e27b9a2-6cfd-46cd-a497-d8a295812c26" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-quobyte-7e27b9a2-6cfd-46cd-a497-d8a295812c26" released by "delete_volume" :: held 0.817s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Created reservations ['77481835-0ae3-4b1b-876b-ab696fcee8d6', '1a980657-4416-42cf-b39f-bffeae238330', '3cce3fa4-c3fa-4de8-9839-7d3217995f12', '2262f9b3-d18e-4091-8391-fb59a9a3d16e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:04 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:04 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:04 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.357s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Deleted volume successfully. Nov 05 10:59:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-def0e374-68c0-49e1-a768-a36d697599f5 tempest-VolumesTransfersTest-1655733948 None] Lock "cinder-7e27b9a2-6cfd-46cd-a497-d8a295812c26-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-3bc423b0-74e4-4ff5-b91f-f0a0dcd6aec4 req-f6a9cf34-a314-42b6-8d43-fb2a6c163a18 tempest-ServerActionsTestOtherA-1565441553 None] Terminate volume connection completed successfully. Nov 05 10:59:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-3bc423b0-74e4-4ff5-b91f-f0a0dcd6aec4 req-f6a9cf34-a314-42b6-8d43-fb2a6c163a18 tempest-ServerActionsTestOtherA-1565441553 None] Deleting attachment 1c1bcae6-c3ba-47dd-a244-4195d6a34d4e. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (dbcad41a-b152-421d-b5da-bf86f2ff6a61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f09d534-adcd-4499-97d2-738c8175d17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f09d534-adcd-4499-97d2-738c8175d17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-217280755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4cab57-9903-46a1-8630-e7b59793a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:13Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a9e010-dabd-424b-88dc-d4837ae07070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0a9e010-dabd-424b-88dc-d4837ae07070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a43a424-ab12-4be5-a52f-f1754c5e326c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a43a424-ab12-4be5-a52f-f1754c5e326c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c4cab57-9903-46a1-8630-e7b59793a614', 'volume_name': 'volume-6c4cab57-9903-46a1-8630-e7b59793a614', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2331b8-d1ae-4239-a6fd-730dbdc29b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec2331b8-d1ae-4239-a6fd-730dbdc29b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecb4106-11c0-4066-9750-3d299a75f746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:13 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Volume 6c4cab57-9903-46a1-8630-e7b59793a614: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c4cab57-9903-46a1-8630-e7b59793a614', 'volume_size': 1} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-217280755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c4cab57-9903-46a1-8630-e7b59793a614,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:13Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Creating volume 6c4cab57-9903-46a1-8630-e7b59793a614 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:13 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:13 devstack sudo[95906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 1073741824 Nov 05 10:59:13 devstack sudo[95906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Flow 'volume_create_manager' (64649d07-5cd7-44f6-8ffb-bd9b30a76238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:14 devstack sudo[95906]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d9540-91f0-4b6c-afe0-69433900b9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 1073741824" returned: 0 in 0.901s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (230d9540-91f0-4b6c-afe0-69433900b9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2041457927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecfdcd2-b430-4e55-9da7-42872916f1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49b40c60c8b749da8a25f5cb30166b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:14Z,use_quota=True,user_id='dfa9cbd51b5e4bedab53178dc466b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ff681b-0346-4bf8-9e02-14fdaf570d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97ff681b-0346-4bf8-9e02-14fdaf570d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f7c52-00a3-41fc-b5e9-6b8c171d726c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (006f7c52-00a3-41fc-b5e9-6b8c171d726c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ecfdcd2-b430-4e55-9da7-42872916f1bb', 'volume_name': 'volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb', 'volume_size': 2}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588ab8e4-2ca9-4e95-9fcd-6d5a3fd9162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588ab8e4-2ca9-4e95-9fcd-6d5a3fd9162c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4c32d8-94b8-4e77-a07a-8d9b69abd208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:14 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Volume 7ecfdcd2-b430-4e55-9da7-42872916f1bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb', 'volume_size': 2} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:14 devstack sudo[95914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 Nov 05 10:59:14 devstack sudo[95914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:14 devstack sudo[95914]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] <== create_volume: return (1354ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.371s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-2041457927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ecfdcd2-b430-4e55-9da7-42872916f1bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49b40c60c8b749da8a25f5cb30166b3e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:14Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:14Z,use_quota=True,user_id='dfa9cbd51b5e4bedab53178dc466b11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Creating volume 7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:14 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb 2147483648 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:14 devstack sudo[95917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb 2147483648 Nov 05 10:59:14 devstack sudo[95917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ecb4106-11c0-4066-9750-3d299a75f746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c4cab57-9903-46a1-8630-e7b59793a614', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b305999-5ccc-4837-995a-41654dcb857c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Volume volume-6c4cab57-9903-46a1-8630-e7b59793a614 (6c4cab57-9903-46a1-8630-e7b59793a614): created successfully Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b305999-5ccc-4837-995a-41654dcb857c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (dbcad41a-b152-421d-b5da-bf86f2ff6a61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-808a0596-522c-4074-996c-c3e84bfb3fd5 tempest-AttachVolumeNegativeTest-2110355174 None] Created volume successfully. Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Flow 'volume_create_manager' (60e1fded-98f1-42a9-bb41-3deec86eedec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83b15d3-1701-4823-ad05-55f935996ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c83b15d3-1701-4823-ad05-55f935996ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2052300063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06badd78028a45e293e1c72eb448756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:15Z,use_quota=True,user_id='6190263a3a5345028632230889003fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7846f9-e9a5-4977-ba64-c10d20fd767c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de7846f9-e9a5-4977-ba64-c10d20fd767c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62e9980-1c02-4e84-a494-f5996cf30dff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62e9980-1c02-4e84-a494-f5996cf30dff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1', 'volume_name': 'volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b38677a-3599-41e5-b7b5-83c69a009c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b38677a-3599-41e5-b7b5-83c69a009c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fda747d-2425-4056-8f46-6f33810b8cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:15 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume 1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1', 'volume_size': 1} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:15 devstack sudo[95917]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb 2147483648" returned: 0 in 0.817s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:15 devstack sudo[95970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb Nov 05 10:59:15 devstack sudo[95970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:16 devstack sudo[95970]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb" returned: 0 in 0.502s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] <== create_volume: return (1394ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.398s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.761s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2052300063',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06badd78028a45e293e1c72eb448756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:15Z,use_quota=True,user_id='6190263a3a5345028632230889003fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Creating volume 1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:16 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a4c32d8-94b8-4e77-a07a-8d9b69abd208) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb', 'volume_size': 2}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26f5820-2a85-4ca0-b30c-bc263e203189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:16 devstack sudo[95990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 1073741824 Nov 05 10:59:16 devstack sudo[95990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:16 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Volume volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb (7ecfdcd2-b430-4e55-9da7-42872916f1bb): created successfully Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26f5820-2a85-4ca0-b30c-bc263e203189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Flow 'volume_create_manager' (64649d07-5cd7-44f6-8ffb-bd9b30a76238) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-25df773d-f663-4ffa-9af2-6ab3ee78f452 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Created volume successfully. Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-dbf1087f-b107-4586-9b6d-d681714d1feb req-c3ccd77b-6959-457f-8181-6e39dfe6abce tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:17 devstack sudo[95990]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 1073741824" returned: 0 in 0.746s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:17 devstack sudo[95998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 Nov 05 10:59:17 devstack sudo[95998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:17 devstack sudo[95998]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-dbf1087f-b107-4586-9b6d-d681714d1feb req-c3ccd77b-6959-457f-8181-6e39dfe6abce tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.788s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-dbf1087f-b107-4586-9b6d-d681714d1feb req-c3ccd77b-6959-457f-8181-6e39dfe6abce tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.665s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fda747d-2425-4056-8f46-6f33810b8cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cb69a1-3deb-4ec2-8dcf-eea202629d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Creating offline snapshot 07c62cbf-6426-44b5-bc67-a0ef76cdb571 of volume 7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 10:59:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 (1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1): created successfully Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cb69a1-3deb-4ec2-8dcf-eea202629d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Flow 'volume_create_manager' (60e1fded-98f1-42a9-bb41-3deec86eedec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[19592460-abd9-4c5f-b31b-23096f6d306f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-dbf1087f-b107-4586-9b6d-d681714d1feb req-c3ccd77b-6959-457f-8181-6e39dfe6abce tempest-AttachVolumeNegativeTest-2110355174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-6c4cab57-9903-46a1-8630-e7b59793a614', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfdf91e6-3202-4804-a098-71b3e0f0b979', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:59:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-87caeec5-129d-42bf-8142-69fca2c0c07c tempest-VolumeQuotasAdminTestJSON-645703700 None] Created volume successfully. Nov 05 10:59:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-dbf1087f-b107-4586-9b6d-d681714d1feb req-c3ccd77b-6959-457f-8181-6e39dfe6abce tempest-AttachVolumeNegativeTest-2110355174 None] attachment_update completed successfully. Nov 05 10:59:17 devstack sudo[96002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb Nov 05 10:59:17 devstack sudo[96002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:18 devstack sudo[96002]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb" returned: 0 in 0.474s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 2G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:18 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 2G Nov 05 10:59:18 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:18 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 2G" returned: 0 in 0.628s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:18 devstack sudo[96428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 Nov 05 10:59:18 devstack sudo[96428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "cinder-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "cinder-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "cinder-quobyte-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "cinder-quobyte-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f78b4074-1956-4304-82bc-463d21d63be0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:19 devstack sudo[96430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 Nov 05 10:59:19 devstack sudo[96430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:19 devstack sudo[96428]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:19 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 is being set with open permissions: ugo+rw Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:19 devstack sudo[96435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 Nov 05 10:59:19 devstack sudo[96435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:19 devstack sudo[96435]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:19 devstack sudo[96430]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" returned: 0 in 0.528s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:19 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1 Nov 05 10:59:19 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Flow 'volume_create_manager' (ab0fc0bf-9c25-4988-b85e-7cb04ec15c79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38af89a1-3b20-4a9b-adc4-93f1a74d6429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38af89a1-3b20-4a9b-adc4-93f1a74d6429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-300934766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f197c6f1-d800-4cf1-9337-f2e37d009f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d65e0d967547e7bf6245fbbf2eab61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:19Z,use_quota=True,user_id='062653a3378143e0b2f15a496c2dc517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8160d358-2f8a-45b5-ad0e-310ac2551f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8160d358-2f8a-45b5-ad0e-310ac2551f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6c69a4-d004-45f0-9531-6bcf1a043588) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:19 devstack sudo[96443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info Nov 05 10:59:19 devstack sudo[96443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:19 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "cinder-quobyte-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1" released by "delete_volume" :: held 0.933s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac6c69a4-d004-45f0-9531-6bcf1a043588) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f197c6f1-d800-4cf1-9337-f2e37d009f01', 'volume_name': 'volume-f197c6f1-d800-4cf1-9337-f2e37d009f01', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c811105-2300-4670-89d8-18007fc8101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c811105-2300-4670-89d8-18007fc8101e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6988a3f2-0f24-4a48-ad30-7f4fac0246b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Volume f197c6f1-d800-4cf1-9337-f2e37d009f01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f197c6f1-d800-4cf1-9337-f2e37d009f01', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Trying to clone f197c6f1-d800-4cf1-9337-f2e37d009f01 from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 10:59:19 devstack sudo[96443]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Created reservations ['7b07e73f-4fc1-4b3c-b0b1-194262487119', '7a0f4b30-4c12-4e15-ad4e-7e5bc4811022', '6486d26c-d851-4da6-a501-467ca8901eec', 'd0b169ca-bb67-4960-bf3b-a1551582f74d'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info" returned: 0 in 0.363s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:19 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info is being set with open permissions: ugo+rw Nov 05 10:59:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:20 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info Nov 05 10:59:20 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:20 devstack sudo[96449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:20 devstack sudo[96449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 10:59:20 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Image download 20.69 MB at 20.69 MB/s Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5f7b5b1-ef5b-4cb3-ab72-15d7c23aa563]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:20 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.info" returned: 0 in 0.526s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:20 devstack sudo[96449]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.989s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.397s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Deleted volume successfully. Nov 05 10:59:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3d844136-004b-49a4-a9f1-37c236b224fb tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Create snapshot completed successfully Nov 05 10:59:20 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19f9c3c2-ca05-4218-8b28-b423a4023813 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "cinder-1d07a0e4-e7eb-4f7a-8197-99ba1037dbd1-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:20 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-dabf325a-a9f0-466b-bdd5-1dab352955d9 req-5f60b66a-1497-4300-a464-d23ae1600bc6 tempest-AttachVolumeNegativeTest-2110355174 None] Terminate volume connection completed successfully. Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-dabf325a-a9f0-466b-bdd5-1dab352955d9 req-5f60b66a-1497-4300-a464-d23ae1600bc6 tempest-AttachVolumeNegativeTest-2110355174 None] Deleting attachment bfdf91e6-3202-4804-a098-71b3e0f0b979. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 10:59:20 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD" returned: 0 in 0.425s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae is fetched for user 062653a3378143e0b2f15a496c2dc517. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acba223-f057-4e76-80a9-67521f37d32e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:21 devstack sudo[96487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD Nov 05 10:59:21 devstack sudo[96487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "cinder-07c62cbf-6426-44b5-bc67-a0ef76cdb571-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-07c62cbf-6426-44b5-bc67-a0ef76cdb571-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "cinder-quobyte-07c62cbf-6426-44b5-bc67-a0ef76cdb571" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-07c62cbf-6426-44b5-bc67-a0ef76cdb571" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Deleting offline snapshot 07c62cbf-6426-44b5-bc67-a0ef76cdb571 of volume 7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] snapshot_file for this snap is: volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fcf0a0-d245-46fd-afc0-791992a81244]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:21 devstack sudo[96487]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD" returned: 0 in 0.532s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-300934766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f197c6f1-d800-4cf1-9337-f2e37d009f01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c2d65e0d967547e7bf6245fbbf2eab61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:19Z,use_quota=True,user_id='062653a3378143e0b2f15a496c2dc517',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Creating volume f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:21 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:21 devstack sudo[96494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1073741824 Nov 05 10:59:21 devstack sudo[96494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:21 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 Nov 05 10:59:21 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Flow 'volume_create_manager' (e1489e42-dcc1-445c-9090-e0286b31876a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8fddb8-d7f9-48ee-8a75-92e907eb6b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c8fddb8-d7f9-48ee-8a75-92e907eb6b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317341305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26acb417-4ee9-4a9f-80f6-85d118987db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06badd78028a45e293e1c72eb448756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:22Z,use_quota=True,user_id='6190263a3a5345028632230889003fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0f2202-8081-469e-b8cd-f61dffdf3a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d0f2202-8081-469e-b8cd-f61dffdf3a2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:22 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9a4453-6dd1-48ea-b1a4-e37803d818c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf9a4453-6dd1-48ea-b1a4-e37803d818c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26acb417-4ee9-4a9f-80f6-85d118987db5', 'volume_name': 'volume-26acb417-4ee9-4a9f-80f6-85d118987db5', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad7c39-4214-4fb4-bc8e-48a19e42c206) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ad7c39-4214-4fb4-bc8e-48a19e42c206) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506cc9c3-fc8f-4255-b44e-0f7336c07ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:22 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume 26acb417-4ee9-4a9f-80f6-85d118987db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26acb417-4ee9-4a9f-80f6-85d118987db5', 'volume_size': 1} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571" returned: 0 in 0.677s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90c77e6-b44d-4bd4-bec0-ca6d829372c0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:22 devstack sudo[96494]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1073741824" returned: 0 in 0.679s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:22 devstack sudo[96505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:22 devstack sudo[96505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:22 devstack sudo[96511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 Nov 05 10:59:22 devstack sudo[96511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:22 devstack sudo[96505]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb" returned: 0 in 0.812s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:22 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 Nov 05 10:59:22 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:22 devstack sudo[96511]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01" returned: 0 in 0.692s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.498s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.916s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-317341305',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26acb417-4ee9-4a9f-80f6-85d118987db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06badd78028a45e293e1c72eb448756c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:22Z,use_quota=True,user_id='6190263a3a5345028632230889003fe9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Creating volume 26acb417-4ee9-4a9f-80f6-85d118987db5 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:23 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:23 devstack sudo[96535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 1073741824 Nov 05 10:59:23 devstack sudo[96535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Attempting download of d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume f197c6f1-d800-4cf1-9337-f2e37d009f01. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02645a5a-b7b6-4cd3-b1be-15337b88187e]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:23 devstack sudo[96537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5 Nov 05 10:59:23 devstack sudo[96537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:23 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571" returned: 0 in 0.749s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:23 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571 Nov 05 10:59:23 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:24 devstack sudo[96537]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5" returned: 0 in 0.801s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:24 devstack sudo[96535]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 1073741824" returned: 0 in 1.097s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:24 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5 Nov 05 10:59:24 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:24 devstack sudo[96555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 Nov 05 10:59:24 devstack sudo[96555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:24 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb.07c62cbf-6426-44b5-bc67-a0ef76cdb571" returned: 0 in 0.726s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-07c62cbf-6426-44b5-bc67-a0ef76cdb571" released by "_delete_snapshot" :: held 3.152s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" released by "delete_snapshot" :: held 3.201s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Created reservations ['9d3bd3c5-5e12-4b87-95ca-b43fd97a5b57', 'd4190ab6-3d79-4427-9c34-fb59c1f267a4', 'ff81fa8f-db22-4688-be5c-5767aa7d5dc7', '0421dd22-dc5e-4b27-8bbd-3fb7f6f1b1fb'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Delete snapshot completed successfully. Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c548dbca-26bb-4966-a8e8-462a4ec75702 tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-07c62cbf-6426-44b5-bc67-a0ef76cdb571-delete_snapshot" released by "delete_snapshot" :: held 3.596s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:24 devstack sudo[96555]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5" returned: 0 in 0.606s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] <== create_volume: return (1908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.915s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (506cc9c3-fc8f-4255-b44e-0f7336c07ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26acb417-4ee9-4a9f-80f6-85d118987db5', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053f609-19ff-49fe-9345-dc9fb26f034e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Volume volume-26acb417-4ee9-4a9f-80f6-85d118987db5 (26acb417-4ee9-4a9f-80f6-85d118987db5): created successfully Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9053f609-19ff-49fe-9345-dc9fb26f034e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:25 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Flow 'volume_create_manager' (e1489e42-dcc1-445c-9090-e0286b31876a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5" returned: 1 in 0.969s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_p4w62tc5' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[929273b3-be17-4dbc-823b-0f83a68064e9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0c46c386-654e-4a9e-8f90-8498aa9c76a5 tempest-VolumeQuotasAdminTestJSON-645703700 None] Created volume successfully. Nov 05 10:59:25 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD Nov 05 10:59:25 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:25 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD" returned: 0 in 0.577s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] d8cb4abc-43bb-420e-94aa-12ceb67e37ae was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:25 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 Nov 05 10:59:25 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "cinder-7ecfdcd2-b430-4e55-9da7-42872916f1bb-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-7ecfdcd2-b430-4e55-9da7-42872916f1bb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" acquired by "delete_volume" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5234a0fc-5c61-41c8-b83b-20ef075cabed]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f54e74c9-277b-406b-afa5-55cb1d041daa tempest-VolumeQuotasAdminTestJSON-1715509895 None] Transfer volume completed successfully. Nov 05 10:59:26 devstack sudo[96573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb Nov 05 10:59:26 devstack sudo[96573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:26 devstack sudo[96573]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb" returned: 0 in 0.544s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:26 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb Nov 05 10:59:26 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Acquiring lock "cinder-26acb417-4ee9-4a9f-80f6-85d118987db5-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "cinder-26acb417-4ee9-4a9f-80f6-85d118987db5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Acquiring lock "cinder-quobyte-26acb417-4ee9-4a9f-80f6-85d118987db5" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "cinder-quobyte-26acb417-4ee9-4a9f-80f6-85d118987db5" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb7686ff-d6d3-45b2-91da-5ba88dadda67]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:27 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ecfdcd2-b430-4e55-9da7-42872916f1bb" returned: 0 in 0.666s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-quobyte-7ecfdcd2-b430-4e55-9da7-42872916f1bb" released by "delete_volume" :: held 1.355s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Created reservations ['1c999f8e-d365-44eb-9a88-3c6654c99a92', '6fce339c-22d2-4394-965a-7211c880239e', 'a16dd5c9-808b-4cf0-9411-eb6376598a5b', '4b867e35-365d-4cc0-824e-0dadbd16aceb'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:27 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 Nov 05 10:59:27 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:27 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:27 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:27 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5" returned: 0 in 0.681s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:27 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5 Nov 05 10:59:27 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:28 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.345s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Deleted volume successfully. Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9b654b69-6664-4ded-9189-1bee6887418b tempest-VolumesSnapshotNegativeTestJSON-1948528139 None] Lock "cinder-7ecfdcd2-b430-4e55-9da7-42872916f1bb-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:28 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-26acb417-4ee9-4a9f-80f6-85d118987db5" returned: 0 in 0.468s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "cinder-quobyte-26acb417-4ee9-4a9f-80f6-85d118987db5" released by "delete_volume" :: held 1.274s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Created reservations ['b2deab74-693f-4ba9-b2a0-5cf37f5cc106', '929522db-203b-4093-8222-2c0a2d55844f', '61820b6b-eb5c-44ac-bd92-103aaa5a7378', '234a2289-6e75-4aa7-bc48-44335495b84b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:28 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:28 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:28 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01" returned: 0 in 3.155s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_6o2g43n1devstack@QuobyteHD, size 112.00 MB, duration 3.16 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 10:59:28 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Converted 112.00 MB image at 35.47 MB/s Nov 05 10:59:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:28 devstack sudo[96598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1G Nov 05 10:59:28 devstack sudo[96598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:29 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.452s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Deleted volume successfully. Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edf98dc8-dd31-454f-92f7-f5bd61eb48fa tempest-VolumeQuotasAdminTestJSON-2018071655 None] Lock "cinder-26acb417-4ee9-4a9f-80f6-85d118987db5-delete_volume" released by "delete_volume" :: held 2.090s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:29 devstack sudo[96598]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 1G" returned: 0 in 0.554s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Downloaded image d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume f197c6f1-d800-4cf1-9337-f2e37d009f01 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae for user 062653a3378143e0b2f15a496c2dc517 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Marking volume f197c6f1-d800-4cf1-9337-f2e37d009f01 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Copying metadata from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae to f197c6f1-d800-4cf1-9337-f2e37d009f01. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Creating volume glance metadata for volume f197c6f1-d800-4cf1-9337-f2e37d009f01 backed by image d8cb4abc-43bb-420e-94aa-12ceb67e37ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6988a3f2-0f24-4a48-ad30-7f4fac0246b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f197c6f1-d800-4cf1-9337-f2e37d009f01', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6f18f9-1675-4d68-8d35-d4b244a6f025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:29 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Volume volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 (f197c6f1-d800-4cf1-9337-f2e37d009f01): created successfully Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b6f18f9-1675-4d68-8d35-d4b244a6f025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Flow 'volume_create_manager' (ab0fc0bf-9c25-4988-b85e-7cb04ec15c79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-71074979-5827-43db-a10c-67d3f4fd8f7c tempest-ServerActionsTestOtherA-1565441553 None] Created volume successfully. Nov 05 10:59:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-35f1a1a7-ba49-4097-a073-b2fc54f07afe req-88e8788a-be37-4f32-9ee3-a3e1d2acb82a tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-35f1a1a7-ba49-4097-a073-b2fc54f07afe req-88e8788a-be37-4f32-9ee3-a3e1d2acb82a tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-35f1a1a7-ba49-4097-a073-b2fc54f07afe req-88e8788a-be37-4f32-9ee3-a3e1d2acb82a tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-35f1a1a7-ba49-4097-a073-b2fc54f07afe req-88e8788a-be37-4f32-9ee3-a3e1d2acb82a tempest-ServerActionsTestOtherA-1565441553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-f197c6f1-d800-4cf1-9337-f2e37d009f01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '042a321a-f2a4-44b7-82da-5e232d66e7d6', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 10:59:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-35f1a1a7-ba49-4097-a073-b2fc54f07afe req-88e8788a-be37-4f32-9ee3-a3e1d2acb82a tempest-ServerActionsTestOtherA-1565441553 None] attachment_update completed successfully. Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Flow 'volume_create_manager' (b7f8a45b-e677-4520-9590-95a7edc3f4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d122bba-c6af-4224-b88d-441946792c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d122bba-c6af-4224-b88d-441946792c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-808180140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53547c-cae3-487c-8aae-a18eee30c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a016d61fa442cc93e068d948ab619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:42Z,use_quota=True,user_id='b91b66d9a8d747adaceedc8a34e3157f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91bb9b45-8bbc-4ba9-a1e3-6d1d7bf89c41),volume_type_id=91bb9b45-8bbc-4ba9-a1e3-6d1d7bf89c41)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5506e1f7-a964-4efa-a17b-ef7832c36259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5506e1f7-a964-4efa-a17b-ef7832c36259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b23f837-00c8-42b5-9f84-78b96f8f5297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b23f837-00c8-42b5-9f84-78b96f8f5297) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b53547c-cae3-487c-8aae-a18eee30c2fc', 'volume_name': 'volume-2b53547c-cae3-487c-8aae-a18eee30c2fc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb05c90-292c-40c2-be29-e5c5617a690d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bb05c90-292c-40c2-be29-e5c5617a690d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502be793-8404-4726-814e-b85ec1015728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:41 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Volume 2b53547c-cae3-487c-8aae-a18eee30c2fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b53547c-cae3-487c-8aae-a18eee30c2fc', 'volume_size': 1} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T09:59:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-808180140',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b53547c-cae3-487c-8aae-a18eee30c2fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06a016d61fa442cc93e068d948ab619b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T09:59:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T09:59:42Z,use_quota=True,user_id='b91b66d9a8d747adaceedc8a34e3157f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91bb9b45-8bbc-4ba9-a1e3-6d1d7bf89c41),volume_type_id=91bb9b45-8bbc-4ba9-a1e3-6d1d7bf89c41)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Creating volume 2b53547c-cae3-487c-8aae-a18eee30c2fc {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 10:59:41 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 10:59:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:41 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc 1073741824 Nov 05 10:59:41 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:42 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc 1073741824" returned: 0 in 0.726s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:42 devstack sudo[96649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc Nov 05 10:59:42 devstack sudo[96649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc" returned: 0 in 0.392s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] <== create_volume: return (1184ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:42 devstack sudo[96649]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (502be793-8404-4726-814e-b85ec1015728) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b53547c-cae3-487c-8aae-a18eee30c2fc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab80aa-f161-4315-a652-8f288a482d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 10:59:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Volume volume-2b53547c-cae3-487c-8aae-a18eee30c2fc (2b53547c-cae3-487c-8aae-a18eee30c2fc): created successfully Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69ab80aa-f161-4315-a652-8f288a482d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 10:59:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Flow 'volume_create_manager' (b7f8a45b-e677-4520-9590-95a7edc3f4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 10:59:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-05a1cb23-1d13-4938-97de-5a8fb15ad250 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Created volume successfully. Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:44 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:44 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:45 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.785s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:45 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6a7aac74-8b55-450e-9508-ee5e75fce091 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Retype volume completed successfully. Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "cinder-2b53547c-cae3-487c-8aae-a18eee30c2fc-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "cinder-2b53547c-cae3-487c-8aae-a18eee30c2fc-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "cinder-quobyte-2b53547c-cae3-487c-8aae-a18eee30c2fc" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "cinder-quobyte-2b53547c-cae3-487c-8aae-a18eee30c2fc" acquired by "delete_volume" :: waited 0.049s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ded8dfc8-02f3-430a-97a0-cfb72f6b6b8e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:47 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc Nov 05 10:59:47 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:47 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc" returned: 0 in 0.607s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:48 devstack sudo[97180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc Nov 05 10:59:48 devstack sudo[97180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:48 devstack sudo[97180]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-2b53547c-cae3-487c-8aae-a18eee30c2fc" returned: 0 in 0.395s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "cinder-quobyte-2b53547c-cae3-487c-8aae-a18eee30c2fc" released by "delete_volume" :: held 1.095s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:48 devstack cinder-volume[87369]: WARNING cinder.quota [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:59:48 devstack cinder-volume[87369]: WARNING cinder.quota [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Created reservations ['bd370732-fa4c-453e-9ecb-3d76b07eddf3', 'a7cf010e-1289-4e76-865f-33a08b9a71c7', '65410e30-fcdd-4240-9841-f8efd4c71f55', 'a2ff5a6b-ab8a-4725-8623-4976e5b59061'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:48 devstack sudo[97184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:48 devstack sudo[97184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:48 devstack sudo[97184]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.322s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:48 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Deleted volume successfully. Nov 05 10:59:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ae8a55c7-afe5-47f5-9243-3334345cf8f5 tempest-VolumeRetypeWithoutMigrationTest-9471801 None] Lock "cinder-2b53547c-cae3-487c-8aae-a18eee30c2fc-delete_volume" released by "delete_volume" :: held 1.945s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 10:59:50 devstack sudo[97188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 10:59:50 devstack sudo[97188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 10:59:50 devstack sudo[97188]: pam_unix(sudo:session): session closed for user root Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.701s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 10:59:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 10:59:51 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 10:59:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 10:59:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 10:59:58 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=93,cinder:UPDATE=87,cinder:INSERT=28,cinder:DELETE=6 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 10:59:59 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=79,cinder:UPDATE=90,cinder:INSERT=22,cinder:DELETE=9 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:00:07 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-3a617883-832f-410b-b0d6-8ded0344e00e tempest-ServerActionsTestOtherA-1565441553 None] Terminate volume connection completed successfully. Nov 05 11:00:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-3a617883-832f-410b-b0d6-8ded0344e00e tempest-ServerActionsTestOtherA-1565441553 None] Deleting attachment 042a321a-f2a4-44b7-82da-5e232d66e7d6. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:00:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-94249881-dac9-454e-9c22-bd260c0132e7 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-94249881-dac9-454e-9c22-bd260c0132e7 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-94249881-dac9-454e-9c22-bd260c0132e7 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-94249881-dac9-454e-9c22-bd260c0132e7 tempest-ServerActionsTestOtherA-1565441553 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-f197c6f1-d800-4cf1-9337-f2e37d009f01', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d6bb320-f0ec-4f26-bdf2-64a3e801137c', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:00:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-4dedb055-341e-40ee-a30c-a47d0adceb89 req-94249881-dac9-454e-9c22-bd260c0132e7 tempest-ServerActionsTestOtherA-1565441553 None] attachment_update completed successfully. Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (c9e2c04b-0c77-427c-b91c-56c1ef0fa884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e0c733-5c61-43e0-8a91-517d2a320973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e0c733-5c61-43e0-8a91-517d2a320973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881548226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593541b9-c195-4aa4-a209-a9f954a72aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:20Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5f83d5-6588-4fe9-bf67-d0708ecc4fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a5f83d5-6588-4fe9-bf67-d0708ecc4fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f99cf4d-a5e9-4902-bc16-593776dc20ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f99cf4d-a5e9-4902-bc16-593776dc20ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '593541b9-c195-4aa4-a209-a9f954a72aa3', 'volume_name': 'volume-593541b9-c195-4aa4-a209-a9f954a72aa3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05f2d1b-5d81-4bd5-be3f-3a467acd979f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05f2d1b-5d81-4bd5-be3f-3a467acd979f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed52b12c-75f5-428d-b532-9ddf63007281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:20 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Volume 593541b9-c195-4aa4-a209-a9f954a72aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-593541b9-c195-4aa4-a209-a9f954a72aa3', 'volume_size': 1} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1881548226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=593541b9-c195-4aa4-a209-a9f954a72aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4146ea5dd48d4ff084e3770a6f43591a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:20Z,use_quota=True,user_id='753e677b9abb41fe94d67914ebf0ba48',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Creating volume 593541b9-c195-4aa4-a209-a9f954a72aa3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:20 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:20 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 1073741824 Nov 05 11:00:20 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:21 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 1073741824" returned: 0 in 1.081s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:21 devstack sudo[97806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 Nov 05 11:00:21 devstack sudo[97806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:22 devstack sudo[97806]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3" returned: 0 in 0.650s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] <== create_volume: return (1822ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.826s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed52b12c-75f5-428d-b532-9ddf63007281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-593541b9-c195-4aa4-a209-a9f954a72aa3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572c23bd-cbe7-4e80-8aee-d5358a7df4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Volume volume-593541b9-c195-4aa4-a209-a9f954a72aa3 (593541b9-c195-4aa4-a209-a9f954a72aa3): created successfully Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (572c23bd-cbe7-4e80-8aee-d5358a7df4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Flow 'volume_create_manager' (c9e2c04b-0c77-427c-b91c-56c1ef0fa884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-73e272ce-5c9c-4d63-8743-0d270a9f1c5c tempest-AttachVolumeNegativeTest-2110355174 None] Created volume successfully. Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (fb132d3b-32b9-48bb-a55d-07337a4691b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9a1a8c-c368-4f81-81fd-df686bf2f77c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd9a1a8c-c368-4f81-81fd-df686bf2f77c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-391568410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de0e09f-9475-497a-b397-87abb109b265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb77db534314835b765fed69385b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:23Z,use_quota=True,user_id='dd2d5ba1810840f4858505d2ff1f2931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3764ddfc-6d93-4c4d-bf10-9e329bc694a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3764ddfc-6d93-4c4d-bf10-9e329bc694a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3207f7-2377-4220-b6e5-e873bbfa9ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e3207f7-2377-4220-b6e5-e873bbfa9ccb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1de0e09f-9475-497a-b397-87abb109b265', 'volume_name': 'volume-1de0e09f-9475-497a-b397-87abb109b265', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1557670-ecb8-4038-b7f7-eb184494ab07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1557670-ecb8-4038-b7f7-eb184494ab07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd7caf7-9cd9-4004-9f67-25f99b3fc6a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:22 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Volume 1de0e09f-9475-497a-b397-87abb109b265: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1de0e09f-9475-497a-b397-87abb109b265', 'volume_size': 1} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-391568410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1de0e09f-9475-497a-b397-87abb109b265,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb77db534314835b765fed69385b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:23Z,use_quota=True,user_id='dd2d5ba1810840f4858505d2ff1f2931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Creating volume 1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:22 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:22 devstack sudo[97810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 1073741824 Nov 05 11:00:22 devstack sudo[97810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:23 devstack sudo[97810]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 1073741824" returned: 0 in 0.609s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:23 devstack sudo[97819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:23 devstack sudo[97819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:24 devstack sudo[97819]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.652s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] <== create_volume: return (1330ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (6308a0f3-2f56-4e18-8bd4-4d7984778db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddcf878-522f-4c2a-ac46-8986ceac0641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdd7caf7-9cd9-4004-9f67-25f99b3fc6a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1de0e09f-9475-497a-b397-87abb109b265', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c2388a-c65c-437f-9b41-8ea5d1c34fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ddcf878-522f-4c2a-ac46-8986ceac0641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-229632634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af17a75-084d-4d08-89e1-7258ae1e677a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:24Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0916589b-6488-419d-a1a0-c6266f6598ca),volume_type_id=0916589b-6488-419d-a1a0-c6266f6598ca)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cc1bc8-72a0-4a4b-949f-d8dbe7ce96db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3cc1bc8-72a0-4a4b-949f-d8dbe7ce96db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932d7377-0afd-41fc-9134-29ff271fe9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (932d7377-0afd-41fc-9134-29ff271fe9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9af17a75-084d-4d08-89e1-7258ae1e677a', 'volume_name': 'volume-9af17a75-084d-4d08-89e1-7258ae1e677a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acf285e-2acf-4344-a491-ea1277927c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9acf285e-2acf-4344-a491-ea1277927c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108bb34b-b94d-484b-b040-93c5fe482f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Volume 9af17a75-084d-4d08-89e1-7258ae1e677a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9af17a75-084d-4d08-89e1-7258ae1e677a', 'volume_size': 1} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-229632634',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9af17a75-084d-4d08-89e1-7258ae1e677a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:24Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0916589b-6488-419d-a1a0-c6266f6598ca),volume_type_id=0916589b-6488-419d-a1a0-c6266f6598ca)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Creating volume 9af17a75-084d-4d08-89e1-7258ae1e677a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:24 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Volume volume-1de0e09f-9475-497a-b397-87abb109b265 (1de0e09f-9475-497a-b397-87abb109b265): created successfully Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83c2388a-c65c-437f-9b41-8ea5d1c34fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a 1073741824 Nov 05 11:00:24 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (fb132d3b-32b9-48bb-a55d-07337a4691b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d675894a-13d9-4eca-8f2e-8b6a81c1befc tempest-VolumesDeleteCascade-1307253988 None] Created volume successfully. Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-82432a7c-d207-4f19-a16b-ce2ea89c8b95 req-103cdbfe-db4c-4fe8-ac65-fc8a064e2957 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (e7db7365-46a4-4877-b04b-85661c469395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5bd1ef-bded-40e8-b2e7-3a9cb8d8fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b5bd1ef-bded-40e8-b2e7-3a9cb8d8fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273763111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208dc6b9-f194-441f-8496-a58d6d00299b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:25Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969c800b-b390-4d82-a8a9-26a1525dec8f),volume_type_id=969c800b-b390-4d82-a8a9-26a1525dec8f)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6368b2-c7ec-4bc5-bfdf-c4da792faedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6368b2-c7ec-4bc5-bfdf-c4da792faedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10831d94-6d9b-4b71-9ece-2643bf8c0c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10831d94-6d9b-4b71-9ece-2643bf8c0c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208dc6b9-f194-441f-8496-a58d6d00299b', 'volume_name': 'volume-208dc6b9-f194-441f-8496-a58d6d00299b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb298bb1-8950-4936-a2de-6caeb0c9a315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb298bb1-8950-4936-a2de-6caeb0c9a315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802acf7f-6f1b-4bf7-8e23-b8b1ca3dbebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume 208dc6b9-f194-441f-8496-a58d6d00299b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208dc6b9-f194-441f-8496-a58d6d00299b', 'volume_size': 1} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:25 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a 1073741824" returned: 0 in 0.744s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:25 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a Nov 05 11:00:25 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:25 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a" returned: 0 in 0.371s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-82432a7c-d207-4f19-a16b-ce2ea89c8b95 req-103cdbfe-db4c-4fe8-ac65-fc8a064e2957 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.876s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-82432a7c-d207-4f19-a16b-ce2ea89c8b95 req-103cdbfe-db4c-4fe8-ac65-fc8a064e2957 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.585s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-273763111',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208dc6b9-f194-441f-8496-a58d6d00299b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:25Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(969c800b-b390-4d82-a8a9-26a1525dec8f),volume_type_id=969c800b-b390-4d82-a8a9-26a1525dec8f)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Creating volume 208dc6b9-f194-441f-8496-a58d6d00299b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:25 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:25 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b 1073741824 Nov 05 11:00:25 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (108bb34b-b94d-484b-b040-93c5fe482f4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9af17a75-084d-4d08-89e1-7258ae1e677a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01df073e-0731-4c7e-8f0b-7a579614de2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (f81aea6d-ca97-4e51-9ced-c3f658809916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4190ddaa-50ca-4ba2-99d2-fe449cc674d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-82432a7c-d207-4f19-a16b-ce2ea89c8b95 req-103cdbfe-db4c-4fe8-ac65-fc8a064e2957 tempest-AttachVolumeNegativeTest-2110355174 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-593541b9-c195-4aa4-a209-a9f954a72aa3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f7d84860-30f9-47ef-88cd-ffc1155029fa', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:00:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Volume volume-9af17a75-084d-4d08-89e1-7258ae1e677a (9af17a75-084d-4d08-89e1-7258ae1e677a): created successfully Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01df073e-0731-4c7e-8f0b-7a579614de2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (6308a0f3-2f56-4e18-8bd4-4d7984778db3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4190ddaa-50ca-4ba2-99d2-fe449cc674d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1415798766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4b74b2-b45d-462f-a632-fcbcede6b380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:26Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(366c107d-3159-408c-90ce-87c61fb65457),volume_type_id=366c107d-3159-408c-90ce-87c61fb65457)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd77297a-09f0-4f70-9816-f8af98a1626e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd77297a-09f0-4f70-9816-f8af98a1626e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef358a08-8ed5-4f0b-9032-3901538e78b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:25 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:00:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-658f1c2e-9bfe-4ffc-82ac-cc6dd06efe3f tempest-TestInstancesWithCinderVolumes-810213748 None] Created volume successfully. Nov 05 11:00:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-82432a7c-d207-4f19-a16b-ce2ea89c8b95 req-103cdbfe-db4c-4fe8-ac65-fc8a064e2957 tempest-AttachVolumeNegativeTest-2110355174 None] attachment_update completed successfully. Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:26 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b 1073741824" returned: 0 in 0.697s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:26 devstack sudo[97847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b Nov 05 11:00:26 devstack sudo[97847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef358a08-8ed5-4f0b-9032-3901538e78b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef4b74b2-b45d-462f-a632-fcbcede6b380', 'volume_name': 'volume-ef4b74b2-b45d-462f-a632-fcbcede6b380', 'volume_size': 1, 'image_id': '50c42416-f384-45e7-9442-6dada11abbd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--565528690', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '758d89be1d9f4e7caf36d0aacf32b93c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50c42416-f384-45e7-9442-6dada11abbd3', 'created_at': datetime.datetime(2026, 11, 5, 10, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 0, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50c42416-f384-45e7-9442-6dada11abbd3/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0f6a42-b88f-4235-80ca-6ac58a60560d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f0f6a42-b88f-4235-80ca-6ac58a60560d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e91cc4c-2d2d-4628-b6ff-347b93aed8de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:26 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume ef4b74b2-b45d-462f-a632-fcbcede6b380: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef4b74b2-b45d-462f-a632-fcbcede6b380', 'volume_size': 1, 'image_id': '50c42416-f384-45e7-9442-6dada11abbd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--565528690', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '758d89be1d9f4e7caf36d0aacf32b93c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50c42416-f384-45e7-9442-6dada11abbd3', 'created_at': datetime.datetime(2026, 11, 5, 10, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 0, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50c42416-f384-45e7-9442-6dada11abbd3/file', 'properties': {}}, 'image_service': } Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Trying to clone ef4b74b2-b45d-462f-a632-fcbcede6b380 from image 50c42416-f384-45e7-9442-6dada11abbd3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:00:26 devstack sudo[97847]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b" returned: 0 in 0.370s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.161s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.685s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Creating offline snapshot 90d6349a-219c-47ee-a07c-401008e17505 of volume 1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (802acf7f-6f1b-4bf7-8e23-b8b1ca3dbebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208dc6b9-f194-441f-8496-a58d6d00299b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c29e5fe-5c0d-4fc7-b789-e248b14f8179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fca85a1-ba52-4013-b55d-ddc5cdf84e8b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:26 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume volume-208dc6b9-f194-441f-8496-a58d6d00299b (208dc6b9-f194-441f-8496-a58d6d00299b): created successfully Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c29e5fe-5c0d-4fc7-b789-e248b14f8179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (e7db7365-46a4-4877-b04b-85661c469395) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5428875b-bbac-46d2-9870-4c6c29dbfb52 tempest-TestInstancesWithCinderVolumes-810213748 None] Created volume successfully. Nov 05 11:00:27 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:27 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:27 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.495s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:27 devstack sudo[97855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 1G Nov 05 11:00:27 devstack sudo[97855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:27 devstack sudo[97855]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 1G" returned: 0 in 0.482s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:27 devstack sudo[97862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:27 devstack sudo[97862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:28 devstack sudo[97862]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.409s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:28 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 is being set with open permissions: ugo+rw Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:28 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:28 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:28 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.364s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:28 devstack sudo[97871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info Nov 05 11:00:28 devstack sudo[97871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:28 devstack sudo[97871]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:28 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info is being set with open permissions: ugo+rw Nov 05 11:00:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:29 devstack sudo[97876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info Nov 05 11:00:29 devstack sudo[97876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-69dec908-5280-4ebf-bcfc-6e33daa6ffbb req-5270e76f-f83b-4005-9aa2-d9fbdda17e05 tempest-AttachVolumeNegativeTest-2110355174 None] Terminate volume connection completed successfully. Nov 05 11:00:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-69dec908-5280-4ebf-bcfc-6e33daa6ffbb req-5270e76f-f83b-4005-9aa2-d9fbdda17e05 tempest-AttachVolumeNegativeTest-2110355174 None] Deleting attachment f7d84860-30f9-47ef-88cd-ffc1155029fa. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:00:29 devstack sudo[97876]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.info" returned: 0 in 0.445s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.667s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-10ae9db9-8455-44d3-a335-0c1ecefdcaf4 tempest-VolumesDeleteCascade-1307253988 None] Create snapshot completed successfully Nov 05 11:00:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Creating offline snapshot f5b86503-09e3-49ad-8157-1bb8994faf41 of volume 1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:00:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[caad3b8a-9af5-4cc2-acaa-632a0eb767b5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:31 devstack sudo[97899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:31 devstack sudo[97899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:31 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD, size 20.69 MB, duration 5.18 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:00:31 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Image download 20.69 MB at 3.99 MB/s Nov 05 11:00:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b5fd7-1a25-4f6d-b7d4-39184440b871]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:31 devstack sudo[97899]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.955s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de0e09f-9475-497a-b397-87abb109b265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:32 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 1G Nov 05 11:00:32 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:32 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD Nov 05 11:00:32 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:32 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD" returned: 0 in 0.816s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Temporary image 50c42416-f384-45e7-9442-6dada11abbd3 is fetched for user 3d20c7256b9d4be8bf63252665ba1143. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b230621e-793f-49a2-9cf1-e8b3642547b5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:32 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 1G" returned: 0 in 0.907s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:33 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:33 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:33 devstack sudo[97943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD Nov 05 11:00:33 devstack sudo[97943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:33 devstack sudo[97943]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD" returned: 0 in 0.690s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:33 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.765s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:33 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 is being set with open permissions: ugo+rw Nov 05 11:00:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:33 devstack sudo[97956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:33 devstack sudo[97956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:34 devstack sudo[97956]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.412s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.247s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.628s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1415798766',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef4b74b2-b45d-462f-a632-fcbcede6b380,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='758d89be1d9f4e7caf36d0aacf32b93c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:26Z,use_quota=True,user_id='3d20c7256b9d4be8bf63252665ba1143',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(366c107d-3159-408c-90ce-87c61fb65457),volume_type_id=366c107d-3159-408c-90ce-87c61fb65457)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Creating volume ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:34 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:34 devstack sudo[97963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1073741824 Nov 05 11:00:34 devstack sudo[97963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ba0f3617-1085-4a2b-ac75-503fb856f8f4 tempest-VolumesDeleteCascade-1307253988 None] Create snapshot completed successfully Nov 05 11:00:34 devstack sudo[97963]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1073741824" returned: 0 in 0.768s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:35 devstack sudo[97968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 Nov 05 11:00:35 devstack sudo[97968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-1de0e09f-9475-497a-b397-87abb109b265-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-1de0e09f-9475-497a-b397-87abb109b265-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Performing cascade delete. {{(pid=87369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-90d6349a-219c-47ee-a07c-401008e17505-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-90d6349a-219c-47ee-a07c-401008e17505-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-90d6349a-219c-47ee-a07c-401008e17505" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-90d6349a-219c-47ee-a07c-401008e17505" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Deleting offline snapshot 90d6349a-219c-47ee-a07c-401008e17505 of volume 1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:00:35 devstack sudo[97968]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] snapshot_file for this snap is: volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380" returned: 0 in 0.562s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] <== create_volume: return (1392ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.396s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dad60c1f-8f2c-44bb-ad2f-ee24888702fd]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Attempting download of 50c42416-f384-45e7-9442-6dada11abbd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}])) to volume ef4b74b2-b45d-462f-a632-fcbcede6b380. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e776a9f1-1c86-487f-9271-90cd35c816cc]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:35 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:35 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:35 devstack sudo[97980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv Nov 05 11:00:35 devstack sudo[97980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:36 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.640s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de0e09f-9475-497a-b397-87abb109b265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:36 devstack sudo[97980]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv" returned: 0 in 0.554s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f694a48-c7f8-4e4a-a1cc-4d281dc3afc6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-593541b9-c195-4aa4-a209-a9f954a72aa3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:36 devstack sudo[97988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-593541b9-c195-4aa4-a209-a9f954a72aa3-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:36 devstack sudo[97988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-quobyte-593541b9-c195-4aa4-a209-a9f954a72aa3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-593541b9-c195-4aa4-a209-a9f954a72aa3" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:36 devstack sudo[97989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:36 devstack sudo[97989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[389d9ce0-c4b1-4e4a-a05f-419b138c4cb9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:36 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 Nov 05 11:00:36 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:36 devstack sudo[97988]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv" returned: 1 in 0.484s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_50c42416-f384-45e7-9442-6dada11abbd3_ihigrsiv' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c740eec-cb00-4a5e-9ff1-2265d39d32b8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:36 devstack sudo[97989]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:36 devstack sudo[97996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD Nov 05 11:00:36 devstack sudo[97996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b8edde4-8bef-45ce-80fe-08a6b364a9e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:37 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3" returned: 0 in 0.510s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:37 devstack sudo[98005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3 Nov 05 11:00:37 devstack sudo[98005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack sudo[98003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:37 devstack sudo[98003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack sudo[97996]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] 50c42416-f384-45e7-9442-6dada11abbd3 was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:37 devstack sudo[98011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 Nov 05 11:00:37 devstack sudo[98011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack sudo[98005]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-593541b9-c195-4aa4-a209-a9f954a72aa3" returned: 0 in 0.335s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack sudo[98003]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.427s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de0e09f-9475-497a-b397-87abb109b265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-593541b9-c195-4aa4-a209-a9f954a72aa3" released by "delete_volume" :: held 0.907s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82fa0f36-82f6-42ac-a29d-40fcf627a33b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Created reservations ['be03eb7e-d044-4b46-8e3e-63a445cf6935', 'bef87c36-be2d-4163-bc83-1a066367424a', '97900e22-23e0-4954-a5a8-9336c992e400', '34e25eaa-d206-415c-8fda-da0ab588c825'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:37 devstack sudo[98021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:37 devstack sudo[98021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:37 devstack sudo[98024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:00:37 devstack sudo[98024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:37 devstack sudo[98024]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:00:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Deleted volume successfully. Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-82292d95-4381-4d45-99db-27cde2bc4577 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-593541b9-c195-4aa4-a209-a9f954a72aa3-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:37 devstack sudo[98021]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de0e09f-9475-497a-b397-87abb109b265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[214e6df3-d316-4874-a3f7-7cc29f362d88]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:38 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:38 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:38 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.509s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:38 devstack sudo[98038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:38 devstack sudo[98038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-6c4cab57-9903-46a1-8630-e7b59793a614-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-6c4cab57-9903-46a1-8630-e7b59793a614-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-quobyte-6c4cab57-9903-46a1-8630-e7b59793a614" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-6c4cab57-9903-46a1-8630-e7b59793a614" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf792eae-d7e2-453b-959e-ac4599b6781f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:39 devstack sudo[98038]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.512s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:39 devstack sudo[98044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505 Nov 05 11:00:39 devstack sudo[98044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:39 devstack sudo[98043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 Nov 05 11:00:39 devstack sudo[98043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:39 devstack sudo[98044]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.90d6349a-219c-47ee-a07c-401008e17505" returned: 0 in 0.392s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 -F qcow2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:39 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 -F qcow2 Nov 05 11:00:39 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:39 devstack sudo[98043]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614" returned: 0 in 0.569s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:39 devstack sudo[98053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614 Nov 05 11:00:39 devstack sudo[98053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:39 devstack sudo[98011]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380" returned: 0 in 2.453s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_50c42416-f384-45e7-9442-6dada11abbd3_w6tke_btdevstack@QuobyteHD, size 112.00 MB, duration 2.45 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:00:39 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Converted 112.00 MB image at 45.63 MB/s Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:39 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1G Nov 05 11:00:39 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:39 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1de0e09f-9475-497a-b397-87abb109b265 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 -F qcow2" returned: 0 in 0.344s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-90d6349a-219c-47ee-a07c-401008e17505" released by "_delete_snapshot" :: held 4.300s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" released by "delete_snapshot" :: held 4.342s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:39 devstack sudo[98053]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6c4cab57-9903-46a1-8630-e7b59793a614" returned: 0 in 0.302s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-6c4cab57-9903-46a1-8630-e7b59793a614" released by "delete_volume" :: held 0.945s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:39 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['c8da2529-bd49-40b3-88ea-ebc7c5d703a8', '7ec80729-9b71-45b2-a241-3adb2809ef10', 'f775cd8b-0cb7-4bbf-bb37-7e05f21bfa38', 'a167b22d-b730-4a48-b12a-9d5cf7d1074d'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Delete snapshot completed successfully. Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-90d6349a-219c-47ee-a07c-401008e17505-delete_snapshot" released by "delete_snapshot" :: held 4.610s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-f5b86503-09e3-49ad-8157-1bb8994faf41-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Created reservations ['d3a2acdc-207f-40a7-b119-b394d49bda41', 'ebd8a434-03fc-4fb3-bf92-0c5677685540', 'fdfdfeeb-f393-4ac3-9525-a64b362ea623', '91d1b3b5-0f41-4c5d-ac9c-2b4aa642d695'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-f5b86503-09e3-49ad-8157-1bb8994faf41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:40 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-f5b86503-09e3-49ad-8157-1bb8994faf41" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 1G" returned: 0 in 0.468s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Downloaded image 50c42416-f384-45e7-9442-6dada11abbd3 ((None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}])) to volume ef4b74b2-b45d-462f-a632-fcbcede6b380 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Temporary image 50c42416-f384-45e7-9442-6dada11abbd3 for user 3d20c7256b9d4be8bf63252665ba1143 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Marking volume ef4b74b2-b45d-462f-a632-fcbcede6b380 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-f5b86503-09e3-49ad-8157-1bb8994faf41" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Deleting offline snapshot f5b86503-09e3-49ad-8157-1bb8994faf41 of volume 1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] snapshot_file for this snap is: volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Copying metadata from image 50c42416-f384-45e7-9442-6dada11abbd3 to ef4b74b2-b45d-462f-a632-fcbcede6b380. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Creating volume glance metadata for volume ef4b74b2-b45d-462f-a632-fcbcede6b380 backed by image 50c42416-f384-45e7-9442-6dada11abbd3 with: {'image_id': '50c42416-f384-45e7-9442-6dada11abbd3', 'image_name': 'tempest-scenario-img--565528690', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b61458-0743-48b2-a0f7-c1c96367dd59]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:40 devstack sudo[98067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:00:40 devstack sudo[98067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e91cc4c-2d2d-4628-b6ff-347b93aed8de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef4b74b2-b45d-462f-a632-fcbcede6b380', 'volume_size': 1, 'image_id': '50c42416-f384-45e7-9442-6dada11abbd3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/50c42416-f384-45e7-9442-6dada11abbd3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--565528690', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '758d89be1d9f4e7caf36d0aacf32b93c', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '50c42416-f384-45e7-9442-6dada11abbd3', 'created_at': datetime.datetime(2026, 11, 5, 10, 0, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 0, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/50c42416-f384-45e7-9442-6dada11abbd3/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b69354-1802-4801-8d71-3d15c1dfdcfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:40 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:40 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Volume volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 (ef4b74b2-b45d-462f-a632-fcbcede6b380): created successfully Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74b69354-1802-4801-8d71-3d15c1dfdcfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Flow 'volume_create_manager' (f81aea6d-ca97-4e51-9ced-c3f658809916) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0d1f6d4b-1e1e-4ab5-b97d-a3b1e29d6572 tempest-TestInstancesWithCinderVolumes-810213748 None] Created volume successfully. Nov 05 11:00:40 devstack sudo[98067]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.323s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:00:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Deleted volume successfully. Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cc272a08-7518-4864-bf68-5a7aecdc90ca tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-6c4cab57-9903-46a1-8630-e7b59793a614-delete_volume" released by "delete_volume" :: held 1.752s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:40 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1de0e09f-9475-497a-b397-87abb109b265(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22ad2945-855e-46ea-850f-b34c43f6ff62]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:40 devstack sudo[98074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:40 devstack sudo[98074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:41 devstack sudo[98074]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.468s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:41 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:41 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-ff42bd3e-b036-4d7c-9f49-6b8864e471b7-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-ff42bd3e-b036-4d7c-9f49-6b8864e471b7-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "cinder-quobyte-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f6b4fa-84e3-43b8-afcd-cbd6021ce66e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:41 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 Nov 05 11:00:41 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:41 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.524s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:41 devstack sudo[98087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41 Nov 05 11:00:41 devstack sudo[98087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:42 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" returned: 0 in 0.569s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:42 devstack sudo[98087]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265.f5b86503-09e3-49ad-8157-1bb8994faf41" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:42 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7 Nov 05 11:00:42 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-f5b86503-09e3-49ad-8157-1bb8994faf41" released by "_delete_snapshot" :: held 2.050s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" released by "delete_snapshot" :: held 2.098s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['2dd2197e-00ca-4805-8ce4-c7f251ce8847', 'f27b5ba3-0018-4652-a5ec-01d1f7f3082f', '5b9b5261-caf8-4877-b17c-3776e469ae22', '79c29c77-f8b6-4d76-8c77-bda727661a7d'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Delete snapshot completed successfully. Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-f5b86503-09e3-49ad-8157-1bb8994faf41-delete_snapshot" released by "delete_snapshot" :: held 2.392s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Snapshots deleted, issuing volume delete {{(pid=87369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[946150a3-1cbd-4a05-9e97-ed3d91843ffa]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:42 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" returned: 0 in 0.523s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-quobyte-ff42bd3e-b036-4d7c-9f49-6b8864e471b7" released by "delete_volume" :: held 1.173s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:42 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:42 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Created reservations ['604b5e14-cbb3-41bb-bbf7-4a39f339ef59', '46c1d326-f924-4d20-a872-5e6287ba1d42', '55753efd-cb23-4975-be2f-51ccafe3abf8', 'b3bb9114-bb81-49cb-b1ae-9aa6341f4a55'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:42 devstack sudo[98098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:00:42 devstack sudo[98098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:43 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.663s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:43 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265 Nov 05 11:00:43 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:43 devstack sudo[98098]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:00:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Deleted volume successfully. Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a0afc715-544a-4fa4-adce-87ccc35c5581 tempest-AttachVolumeNegativeTest-2110355174 None] Lock "cinder-ff42bd3e-b036-4d7c-9f49-6b8864e471b7-delete_volume" released by "delete_volume" :: held 2.007s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:43 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1de0e09f-9475-497a-b397-87abb109b265" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-1de0e09f-9475-497a-b397-87abb109b265" released by "delete_volume" :: held 1.252s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['11afca14-fb97-4ee0-ac57-90b9f165fc96', '2ee3a7f8-6757-40a6-815f-7eebe543749c', '52aae310-b827-462a-8a0e-6da176638af2', '0326b14a-741f-4bb5-b642-add60e03d803'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:43 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:00:43 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:44 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.478s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:44 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:00:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Deleted volume successfully. Nov 05 11:00:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86a070ec-ddc0-4a57-8199-0c99db6fe04b tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-1de0e09f-9475-497a-b397-87abb109b265-delete_volume" released by "delete_volume" :: held 9.157s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (896dc3fb-f308-4f03-8395-4f6086713113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b6a1a9-2084-46f7-b364-b87094339d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2b6a1a9-2084-46f7-b364-b87094339d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734425083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cc3872-c0fd-4701-a13a-828503ee9a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb77db534314835b765fed69385b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:46Z,use_quota=True,user_id='dd2d5ba1810840f4858505d2ff1f2931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489bfe8-1dce-4ebe-ba22-dd99899f1a0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3489bfe8-1dce-4ebe-ba22-dd99899f1a0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb6601e-f158-4eb1-8a20-4ecc7e5a1bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bb6601e-f158-4eb1-8a20-4ecc7e5a1bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55cc3872-c0fd-4701-a13a-828503ee9a62', 'volume_name': 'volume-55cc3872-c0fd-4701-a13a-828503ee9a62', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48079101-95c2-4a60-aa8d-7bf8056bd9d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48079101-95c2-4a60-aa8d-7bf8056bd9d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8db457b-7d31-44ea-bc44-f152c203d54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Volume 55cc3872-c0fd-4701-a13a-828503ee9a62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55cc3872-c0fd-4701-a13a-828503ee9a62', 'volume_size': 1} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1734425083',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55cc3872-c0fd-4701-a13a-828503ee9a62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb77db534314835b765fed69385b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:46Z,use_quota=True,user_id='dd2d5ba1810840f4858505d2ff1f2931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Creating volume 55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:45 devstack sudo[98131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 1073741824 Nov 05 11:00:45 devstack sudo[98131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1fd707f2-5163-4595-b60a-d35893700951 req-dfbda2cc-1140-4085-9d7d-b80f52d618f5 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:46 devstack sudo[98131]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 1073741824" returned: 0 in 0.657s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:46 devstack sudo[98139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:00:46 devstack sudo[98139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:46 devstack sudo[98139]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1fd707f2-5163-4595-b60a-d35893700951 req-dfbda2cc-1140-4085-9d7d-b80f52d618f5 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.977s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8db457b-7d31-44ea-bc44-f152c203d54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55cc3872-c0fd-4701-a13a-828503ee9a62', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ea5d1b-2652-4b8c-a495-66f556daa5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-1fd707f2-5163-4595-b60a-d35893700951 req-dfbda2cc-1140-4085-9d7d-b80f52d618f5 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Volume volume-55cc3872-c0fd-4701-a13a-828503ee9a62 (55cc3872-c0fd-4701-a13a-828503ee9a62): created successfully Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5ea5d1b-2652-4b8c-a495-66f556daa5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (896dc3fb-f308-4f03-8395-4f6086713113) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a1cfdb0b-0e82-4f79-b29e-42ebab9670e5 tempest-VolumesDeleteCascade-1307253988 None] Created volume successfully. Nov 05 11:00:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-1fd707f2-5163-4595-b60a-d35893700951 req-dfbda2cc-1140-4085-9d7d-b80f52d618f5 tempest-TestInstancesWithCinderVolumes-810213748 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-ef4b74b2-b45d-462f-a632-fcbcede6b380', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90e2a01f-2d35-42c0-a225-af8c37859a12', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:00:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-1fd707f2-5163-4595-b60a-d35893700951 req-dfbda2cc-1140-4085-9d7d-b80f52d618f5 tempest-TestInstancesWithCinderVolumes-810213748 None] attachment_update completed successfully. Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Creating offline snapshot d107c818-5c9f-4754-a935-251db2e389e0 of volume 55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[020934a7-6a62-4a72-930f-76d8c759fa0a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:48 devstack sudo[98146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:00:48 devstack sudo[98146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:48 devstack sudo[98146]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.499s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:48 devstack sudo[98153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 1G Nov 05 11:00:48 devstack sudo[98153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:49 devstack sudo[98153]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 1G" returned: 0 in 1.033s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc3872-c0fd-4701-a13a-828503ee9a62 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:49 devstack sudo[98203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc3872-c0fd-4701-a13a-828503ee9a62 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:00:49 devstack sudo[98203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:50 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:00:50 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:50 devstack sudo[98203]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-55cc3872-c0fd-4701-a13a-828503ee9a62 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.733s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:50 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 is being set with open permissions: ugo+rw Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:50 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:00:50 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:50 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:00:50 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:50 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info Nov 05 11:00:50 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:51 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info" returned: 0 in 0.497s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:51 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info is being set with open permissions: ugo+rw Nov 05 11:00:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:51 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info Nov 05 11:00:51 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:51 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.info" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.766s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e5f3a72b-ef40-492a-aff8-7fc8e19b6a2c tempest-VolumesDeleteCascade-1307253988 None] Create snapshot completed successfully Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (e36611d9-e35a-4642-a624-92b4ddb0cb10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caefdeb3-c720-49c4-985b-6bbb5316c8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (caefdeb3-c720-49c4-985b-6bbb5316c8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-344890833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8eb77db534314835b765fed69385b946',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d107c818-5c9f-4754-a935-251db2e389e0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:53Z,use_quota=True,user_id='dd2d5ba1810840f4858505d2ff1f2931',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6a129f-2361-4cb1-8f7b-389d984e0d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6a129f-2361-4cb1-8f7b-389d984e0d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3e0173-881b-470f-8984-11a8585101ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d3e0173-881b-470f-8984-11a8585101ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc', 'volume_name': 'volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc', 'volume_size': 1, 'snapshot_id': 'd107c818-5c9f-4754-a935-251db2e389e0'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d1e4fd-1a30-4b8e-8b67-17d0615c5801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5d1e4fd-1a30-4b8e-8b67-17d0615c5801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f5fe7-5636-47db-b2ff-1373a68eef94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Volume a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc', 'volume_size': 1, 'snapshot_id': 'd107c818-5c9f-4754-a935-251db2e389e0'} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" acquired by "_create_volume_from_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Creating volume a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc from snapshot d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" acquired by "_copy_volume_from_snapshot" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] snapshot: d107c818-5c9f-4754-a935-251db2e389e0, volume: a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53e0a442-c40e-48fc-b329-24e8df597219]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:53 devstack sudo[98246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:00:53 devstack sudo[98246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:54 devstack sudo[98246]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.770s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc3872-c0fd-4701-a13a-828503ee9a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:00:54 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0421e992-c04a-4c36-bd6a-17662307f6d8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:00:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:54 devstack sudo[98252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:00:54 devstack sudo[98252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:55 devstack sudo[98252]: pam_unix(sudo:session): session closed for user root Nov 05 11:00:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.584s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:00:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:00:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:00:55 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:00:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:00:55 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc Nov 05 11:00:55 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Flow 'volume_create_manager' (a06d5307-f921-4cd8-9da0-713d5a9a8cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cdaa9-14e7-4a66-963f-c0c083e8bb33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36cdaa9-14e7-4a66-963f-c0c083e8bb33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010390225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b805e7f5-6987-407e-80dc-3acdb79486d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d84f1b9caccc45c5a4b024de26b31457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:58Z,use_quota=True,user_id='8fb1846bcdec495f84ce149c580ab68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e7d274-d23b-4e41-877d-84ae04570ac2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25e7d274-d23b-4e41-877d-84ae04570ac2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fc41c1-054f-4b4e-acaf-9a97a5cb4f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71fc41c1-054f-4b4e-acaf-9a97a5cb4f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b805e7f5-6987-407e-80dc-3acdb79486d0', 'volume_name': 'volume-b805e7f5-6987-407e-80dc-3acdb79486d0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21963fe7-e805-4e3f-a797-a1b73b9b9c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21963fe7-e805-4e3f-a797-a1b73b9b9c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4ba823-1637-4625-9c58-ee37f8bc1b9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:00:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Volume b805e7f5-6987-407e-80dc-3acdb79486d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b805e7f5-6987-407e-80dc-3acdb79486d0', 'volume_size': 1} Nov 05 11:00:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:06 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=87,cinder:UPDATE=74,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:01:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-7e8fc523-3857-4895-98f6-70206e422bea tempest-ServerActionsTestOtherA-1565441553 None] Terminate volume connection completed successfully. Nov 05 11:01:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-7e8fc523-3857-4895-98f6-70206e422bea tempest-ServerActionsTestOtherA-1565441553 None] Deleting attachment 9d6bb320-f0ec-4f26-bdf2-64a3e801137c. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:01:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "cinder-f197c6f1-d800-4cf1-9337-f2e37d009f01-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-f197c6f1-d800-4cf1-9337-f2e37d009f01-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "cinder-quobyte-f197c6f1-d800-4cf1-9337-f2e37d009f01" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-quobyte-f197c6f1-d800-4cf1-9337-f2e37d009f01" acquired by "delete_volume" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe5c232a-87bc-4d6a-a384-8a293f4712c8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:07 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 Nov 05 11:01:07 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:08 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01" returned: 0 in 0.982s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:08 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01 Nov 05 11:01:08 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:08 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" returned: 0 in 13.177s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62, size 1024.00 MB, duration 13.18 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:01:08 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Converted 1024.00 MB image at 77.70 MB/s Nov 05 11:01:08 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc is being set with open permissions: ugo+rw Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:08 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc Nov 05 11:01:08 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:08 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f197c6f1-d800-4cf1-9337-f2e37d009f01" returned: 0 in 0.382s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-quobyte-f197c6f1-d800-4cf1-9337-f2e37d009f01" released by "delete_volume" :: held 1.512s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:08 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" returned: 0 in 0.357s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.quota [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Created reservations ['6c413084-5946-40b9-a7b7-ea06055ae987', 'abc521ee-6779-4c3a-a83b-6a526b837c61', '4a4d8cdf-3551-41c0-be5a-e1fe9b097dfc', '8dfdc334-94b9-4990-9d56-8afc85f58559'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" released by "_copy_volume_from_snapshot" :: held 15.056s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" released by "_create_volume_from_snapshot" :: held 15.203s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.230s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.830s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-2010390225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b805e7f5-6987-407e-80dc-3acdb79486d0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='d84f1b9caccc45c5a4b024de26b31457',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:00:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:00:58Z,use_quota=True,user_id='8fb1846bcdec495f84ce149c580ab68b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Creating volume b805e7f5-6987-407e-80dc-3acdb79486d0 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:08 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:08 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 1073741824 Nov 05 11:01:08 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9f5fe7-5636-47db-b2ff-1373a68eef94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc', 'volume_size': 1, 'snapshot_id': 'd107c818-5c9f-4754-a935-251db2e389e0'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9519e9-19c1-4be5-beb6-b0b40cdf75a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:08 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Volume volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc (a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc): created successfully Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa9519e9-19c1-4be5-beb6-b0b40cdf75a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:08 devstack sudo[98322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:08 devstack sudo[98322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Flow 'volume_create_manager' (e36611d9-e35a-4642-a624-92b4ddb0cb10) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:08 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ecc7324e-a160-48ad-95b8-fabac0be7f15 tempest-VolumesDeleteCascade-1307253988 None] Created volume successfully. Nov 05 11:01:09 devstack sudo[98322]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.manager [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Deleted volume successfully. Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=86,cinder:UPDATE=81,cinder:INSERT=17,cinder:DELETE=7 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-5ba63035-f658-4d93-8662-2544c45d7f4a req-4ad9bb96-2702-4234-9018-19417569d65d tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-f197c6f1-d800-4cf1-9337-f2e37d009f01-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:09 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 1073741824" returned: 0 in 0.746s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:09 devstack sudo[98328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 Nov 05 11:01:09 devstack sudo[98328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "cinder-f95fa2d0-7629-485f-afe1-0d30d569775f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-f95fa2d0-7629-485f-afe1-0d30d569775f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "cinder-quobyte-f95fa2d0-7629-485f-afe1-0d30d569775f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-quobyte-f95fa2d0-7629-485f-afe1-0d30d569775f" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68674a86-c993-4f86-9552-02f7dbc030a1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:10 devstack sudo[98328]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0" returned: 0 in 0.455s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] <== create_volume: return (1277ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf4ba823-1637-4625-9c58-ee37f8bc1b9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b805e7f5-6987-407e-80dc-3acdb79486d0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff8857c-3c7d-4dfc-aa25-323d3f56a0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:10 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Volume volume-b805e7f5-6987-407e-80dc-3acdb79486d0 (b805e7f5-6987-407e-80dc-3acdb79486d0): created successfully Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ff8857c-3c7d-4dfc-aa25-323d3f56a0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Flow 'volume_create_manager' (a06d5307-f921-4cd8-9da0-713d5a9a8cd0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:10 devstack sudo[98331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f Nov 05 11:01:10 devstack sudo[98331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-fdb2ec1d-cb3f-4b19-874b-9f1fd05bd150 req-704e1857-c787-45fa-9483-4baa87b54be9 tempest-VolumesGetTestJSON-1266902557 None] Created volume successfully. Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-55cc3872-c0fd-4701-a13a-828503ee9a62-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-55cc3872-c0fd-4701-a13a-828503ee9a62-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Performing cascade delete. {{(pid=87369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-d107c818-5c9f-4754-a935-251db2e389e0-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-d107c818-5c9f-4754-a935-251db2e389e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:10 devstack sudo[98331]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f" returned: 0 in 0.747s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Deleting offline snapshot d107c818-5c9f-4754-a935-251db2e389e0 of volume 55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:01:10 devstack sudo[98338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f Nov 05 11:01:10 devstack sudo[98338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] snapshot_file for this snap is: volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac043a4b-80fe-4c35-b4da-b8b287c2f548]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:11 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:01:11 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:11 devstack sudo[98338]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Acquiring lock "cinder-b805e7f5-6987-407e-80dc-3acdb79486d0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f95fa2d0-7629-485f-afe1-0d30d569775f" returned: 0 in 0.439s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-quobyte-f95fa2d0-7629-485f-afe1-0d30d569775f" released by "delete_volume" :: held 1.342s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "cinder-b805e7f5-6987-407e-80dc-3acdb79486d0-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Acquiring lock "cinder-quobyte-b805e7f5-6987-407e-80dc-3acdb79486d0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Created reservations ['e441f807-8605-4060-b42f-e289dcbd9693', '5ae71268-4e08-4757-9708-1bd6266c8440', '76bddb71-d746-4769-b9bf-e3c22d088980', '2ad0c588-087a-4ef7-80e8-1c13ac31c18c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "cinder-quobyte-b805e7f5-6987-407e-80dc-3acdb79486d0" acquired by "delete_volume" :: waited 0.039s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0efec8-32a9-4214-b040-a1e554598e29]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:11 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.687s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-55cc3872-c0fd-4701-a13a-828503ee9a62(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:11 devstack sudo[98347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 Nov 05 11:01:11 devstack sudo[98347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ec1a340-b2e5-46a1-b1e9-d805e8cffea6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:11 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:11 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:11 devstack sudo[98350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:01:11 devstack sudo[98350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:11 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Deleted volume successfully. Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b1bcfba7-cb82-4e4d-a3dc-f747d30cde29 tempest-ServerActionsTestOtherA-1565441553 None] Lock "cinder-f95fa2d0-7629-485f-afe1-0d30d569775f-delete_volume" released by "delete_volume" :: held 2.108s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:11 devstack sudo[98347]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0" returned: 0 in 0.519s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:11 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0 Nov 05 11:01:11 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:12 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b805e7f5-6987-407e-80dc-3acdb79486d0" returned: 0 in 0.406s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "cinder-quobyte-b805e7f5-6987-407e-80dc-3acdb79486d0" released by "delete_volume" :: held 1.023s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:12 devstack sudo[98350]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.901s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG cinder.quota [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Created reservations ['72a4632a-7707-468a-ba48-e071f3f7663d', '8504b4e8-1d40-4a90-81fc-d65e382971f0', 'b3e2cb49-8dd1-4e29-90f6-d4dd85d680c0', '981ae0b8-60c5-42d4-bd81-67354f80955a'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:12 devstack sudo[98367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:01:12 devstack sudo[98367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:12 devstack sudo[98373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:12 devstack sudo[98373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:13 devstack sudo[98373]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.579s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:13 devstack sudo[98367]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.manager [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.744s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Deleted volume successfully. Nov 05 11:01:13 devstack sudo[98395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0 Nov 05 11:01:13 devstack sudo[98395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-a77d44f7-5628-422a-9a36-1f298d6c6cff req-fe563b09-bdcf-4836-8f81-7d006e265089 tempest-VolumesGetTestJSON-1266902557 None] Lock "cinder-b805e7f5-6987-407e-80dc-3acdb79486d0-delete_volume" released by "delete_volume" :: held 2.026s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:13 devstack sudo[98395]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62.d107c818-5c9f-4754-a935-251db2e389e0" returned: 0 in 0.356s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-d107c818-5c9f-4754-a935-251db2e389e0" released by "_delete_snapshot" :: held 2.885s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" released by "delete_snapshot" :: held 2.941s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['830036a0-f0b5-4f83-a25d-363a6a194e1d', 'd5388252-31ed-4c7f-9e6f-1ad15018e639', 'c4837f1a-7f42-4034-bf92-a2e6685ab2d4', '9e3a43a1-d348-4ac1-80e0-5b360c615154'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Delete snapshot completed successfully. Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-d107c818-5c9f-4754-a935-251db2e389e0-delete_snapshot" released by "delete_snapshot" :: held 3.210s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Snapshots deleted, issuing volume delete {{(pid=87369) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e11d72-69db-433b-b9e3-138aa754cd12]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:14 devstack sudo[98399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:01:14 devstack sudo[98399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:14 devstack sudo[98399]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.528s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:14 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62 Nov 05 11:01:14 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:14 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-55cc3872-c0fd-4701-a13a-828503ee9a62" returned: 0 in 0.319s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-55cc3872-c0fd-4701-a13a-828503ee9a62" released by "delete_volume" :: held 0.945s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['2afe7b86-c823-4b63-a65f-322ff2ab832d', 'c7593dbb-22df-466b-906c-57311ba4c994', '6efe9718-76ff-44a3-b137-771b61300f64', '5289b316-ea38-4b1c-89f2-d5ab29c5bf38'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:15 devstack sudo[98409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:15 devstack sudo[98409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:15 devstack sudo[98409]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Deleted volume successfully. Nov 05 11:01:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cf3d0515-8a5f-4924-90a3-b5b0a25edc97 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-55cc3872-c0fd-4701-a13a-828503ee9a62-delete_volume" released by "delete_volume" :: held 4.988s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b805ce5-802f-42ff-b3d5-2fc67c9626e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:16 devstack sudo[98412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc Nov 05 11:01:16 devstack sudo[98412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:16 devstack sudo[98412]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" returned: 0 in 0.470s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:16 devstack sudo[98417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc Nov 05 11:01:16 devstack sudo[98417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:17 devstack sudo[98417]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" returned: 0 in 0.385s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-quobyte-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc" released by "delete_volume" :: held 0.920s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Created reservations ['e0c66162-7338-4e13-9d63-41048252604b', '2b0a7455-6e2b-4c68-b4b3-c1f7def7f61e', 'a04d5937-5d78-4002-9e05-8dab29c888e6', '01c0fdb7-7cec-4a1e-b8fd-c571a306e7ff'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:17 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:17 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:17 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.596s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:17 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Deleted volume successfully. Nov 05 11:01:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-15e269c8-03a6-4962-92a6-70bf68743fb9 tempest-VolumesDeleteCascade-1307253988 None] Lock "cinder-a6a1e42b-a296-4c84-8ba5-cdedb72aa9cc-delete_volume" released by "delete_volume" :: held 1.839s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ffb6bfce-4adf-4113-89b5-11a5083c426e tempest-GroupsTest-1505258122 None] Group tempest-Group1-1511999551: creating Nov 05 11:01:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ffb6bfce-4adf-4113-89b5-11a5083c426e tempest-GroupsTest-1505258122 None] Group tempest-Group1-1511999551: created successfully Nov 05 11:01:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ffb6bfce-4adf-4113-89b5-11a5083c426e tempest-GroupsTest-1505258122 None] Create group completed successfully. Nov 05 11:01:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9ea1bf0d-3ac9-4c01-9f9c-7f05416aedfb tempest-GroupsTest-1505258122 None] Group tempest-Group2-1252099041: creating Nov 05 11:01:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9ea1bf0d-3ac9-4c01-9f9c-7f05416aedfb tempest-GroupsTest-1505258122 None] Group tempest-Group2-1252099041: created successfully Nov 05 11:01:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9ea1bf0d-3ac9-4c01-9f9c-7f05416aedfb tempest-GroupsTest-1505258122 None] Create group completed successfully. Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (c16b27ca-9438-420a-b860-cc6b3a73bd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aaba25-e99a-48bc-bf98-51a0db105a33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82aaba25-e99a-48bc-bf98-51a0db105a33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528403819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61043ead-c825-4cf4-9be8-93d0eb65c0d7,host='devstack@QuobyteHD#QuobyteHD',id=08fb36c6-c788-4767-858d-9067e0c0db6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:24Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf826ca-1725-4ecc-9094-e67ecc7d8f03),volume_type_id=3cf826ca-1725-4ecc-9094-e67ecc7d8f03)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd3e6f-3e93-4936-b944-c663f86f4fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3fd3e6f-3e93-4936-b944-c663f86f4fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edd1d4b-4abc-4510-a6f5-2e83ce4ec884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0edd1d4b-4abc-4510-a6f5-2e83ce4ec884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08fb36c6-c788-4767-858d-9067e0c0db6c', 'volume_name': 'volume-08fb36c6-c788-4767-858d-9067e0c0db6c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d810c0a3-6cb7-4b05-a4e3-52768be5e938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d810c0a3-6cb7-4b05-a4e3-52768be5e938) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc711a65-7bb2-4145-b43d-f170d52dbec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Volume 08fb36c6-c788-4767-858d-9067e0c0db6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08fb36c6-c788-4767-858d-9067e0c0db6c', 'volume_size': 1} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61043ead-c825-4cf4-9be8-93d0eb65c0d7,created_at=2026-11-05T10:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1528403819',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61043ead-c825-4cf4-9be8-93d0eb65c0d7,host='devstack@QuobyteHD#QuobyteHD',id=08fb36c6-c788-4767-858d-9067e0c0db6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:24Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3cf826ca-1725-4ecc-9094-e67ecc7d8f03),volume_type_id=3cf826ca-1725-4ecc-9094-e67ecc7d8f03)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Creating volume 08fb36c6-c788-4767-858d-9067e0c0db6c {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:23 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:23 devstack sudo[98470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c 1073741824 Nov 05 11:01:23 devstack sudo[98470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7c135770-09e4-4df4-b6d8-4c21ac656c26 req-e7947ab0-7afd-46cb-83f7-0e53bfe28f14 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Flow 'volume_create_manager' (c19fbcab-6a1b-4f7d-aa9d-347e8afff23f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9848223-b22b-4cda-ba30-e0cbcf2745b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9848223-b22b-4cda-ba30-e0cbcf2745b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1147067367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed3cdb-c4d0-4353-8f1e-df8042abef3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46968dc24f38429e91aee8658ba9bc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:24Z,use_quota=True,user_id='5b4ee903abe84d18a914ae0bef483fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e91c379-f530-4c52-a0e8-e45520cae855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e91c379-f530-4c52-a0e8-e45520cae855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e744f0a-9d19-4007-abc7-4aa486993259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:01:24 devstack sudo[98470]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c 1073741824" returned: 0 in 0.914s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:24 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c Nov 05 11:01:24 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e744f0a-9d19-4007-abc7-4aa486993259) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4aed3cdb-c4d0-4353-8f1e-df8042abef3d', 'volume_name': 'volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06764c3-55a7-442e-bc4b-5b837b74736b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d06764c3-55a7-442e-bc4b-5b837b74736b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1d399-34a4-4f63-9766-faccdb474ae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Trying to clone 4aed3cdb-c4d0-4353-8f1e-df8042abef3d from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:01:25 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c" returned: 0 in 0.343s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7c135770-09e4-4df4-b6d8-4c21ac656c26 req-e7947ab0-7afd-46cb-83f7-0e53bfe28f14 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.878s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc711a65-7bb2-4145-b43d-f170d52dbec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08fb36c6-c788-4767-858d-9067e0c0db6c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec26232b-d620-4e5f-88e8-8c69018106e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Volume volume-08fb36c6-c788-4767-858d-9067e0c0db6c (08fb36c6-c788-4767-858d-9067e0c0db6c): created successfully Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec26232b-d620-4e5f-88e8-8c69018106e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (c16b27ca-9438-420a-b860-cc6b3a73bd37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-7c135770-09e4-4df4-b6d8-4c21ac656c26 req-e7947ab0-7afd-46cb-83f7-0e53bfe28f14 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.087s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-eb84d564-6de5-44e1-960b-e33cbc0786e7 tempest-GroupsTest-1505258122 None] Created volume successfully. Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-7c135770-09e4-4df4-b6d8-4c21ac656c26 req-e7947ab0-7afd-46cb-83f7-0e53bfe28f14 tempest-TestInstancesWithCinderVolumes-810213748 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-9af17a75-084d-4d08-89e1-7258ae1e677a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '920e6001-bb3c-48d6-b190-39b9496f6a85', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:01:25 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Image download 20.69 MB at 20.69 MB/s Nov 05 11:01:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-7c135770-09e4-4df4-b6d8-4c21ac656c26 req-e7947ab0-7afd-46cb-83f7-0e53bfe28f14 tempest-TestInstancesWithCinderVolumes-810213748 None] attachment_update completed successfully. Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f743aa8-2441-4010-9ef3-ddc3de12f204]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:25 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD Nov 05 11:01:25 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:26 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae is fetched for user 5b4ee903abe84d18a914ae0bef483fb6. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d386e3-c99d-4db2-bb52-209f49da81f5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:26 devstack sudo[98497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD Nov 05 11:01:26 devstack sudo[98497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:26 devstack sudo[98497]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1147067367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aed3cdb-c4d0-4353-8f1e-df8042abef3d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46968dc24f38429e91aee8658ba9bc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:24Z,use_quota=True,user_id='5b4ee903abe84d18a914ae0bef483fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Creating volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:26 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:26 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1073741824 Nov 05 11:01:26 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:27 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1073741824" returned: 0 in 0.762s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Acquiring lock "cinder-quobyte-08fb36c6-c788-4767-858d-9067e0c0db6c" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-08fb36c6-c788-4767-858d-9067e0c0db6c" acquired by "delete_volume" :: waited 0.058s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:27 devstack sudo[98516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d Nov 05 11:01:27 devstack sudo[98516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7f167f-de8e-4c0a-9c67-e96490c884ab]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:27 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c Nov 05 11:01:27 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:28 devstack sudo[98516]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Attempting download of d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aa12a48-9de2-40f9-8abc-d6b78d45d66e]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:28 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c" returned: 0 in 0.580s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:28 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c Nov 05 11:01:28 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:28 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu Nov 05 11:01:28 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:28 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-289ebce3-45df-44f7-98c9-c7ff42fc948f req-8b422769-bc69-436d-a800-59050c448fd6 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-289ebce3-45df-44f7-98c9-c7ff42fc948f req-8b422769-bc69-436d-a800-59050c448fd6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-08fb36c6-c788-4767-858d-9067e0c0db6c" returned: 0 in 0.352s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:28 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu" returned: 0 in 0.508s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-08fb36c6-c788-4767-858d-9067e0c0db6c" released by "delete_volume" :: held 1.033s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-289ebce3-45df-44f7-98c9-c7ff42fc948f req-8b422769-bc69-436d-a800-59050c448fd6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-289ebce3-45df-44f7-98c9-c7ff42fc948f req-8b422769-bc69-436d-a800-59050c448fd6 tempest-TestInstancesWithCinderVolumes-810213748 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-208dc6b9-f194-441f-8496-a58d6d00299b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '54b53f11-de1b-48f4-b3ab-259767fbd84b', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Created reservations ['a30171b3-3b30-47f1-a40a-742568e435a9'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:28 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu Nov 05 11:01:28 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-289ebce3-45df-44f7-98c9-c7ff42fc948f req-8b422769-bc69-436d-a800-59050c448fd6 tempest-TestInstancesWithCinderVolumes-810213748 None] attachment_update completed successfully. Nov 05 11:01:28 devstack cinder-volume[87369]: WARNING cinder.quota [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-393343229 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-393343229, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:28 devstack cinder-volume[87369]: WARNING cinder.quota [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-393343229 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-393343229, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:28 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Created reservations ['ea2c023b-1470-4268-91a2-fcb9ba7f68ab', 'aee5abdb-3b8c-42ca-9a3c-011efe43d6d8', 'ce6d3dde-6cca-46ab-8bea-02ea1fab3f63', '2c0ec485-52a3-42d5-85dc-06869f60c1c8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:29 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu" returned: 1 in 0.487s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_4tz2o7vu' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd4f992-9da2-45f4-96f2-5b02b12ff278]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:29 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:29 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:29 devstack sudo[98550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD Nov 05 11:01:29 devstack sudo[98550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:29 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.519s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b56e513e-0eee-4dcb-a52a-2dab9bf4bbb2 tempest-GroupsTest-1505258122 None] Delete group completed successfully. Nov 05 11:01:29 devstack sudo[98550]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD" returned: 0 in 0.653s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] d8cb4abc-43bb-420e-94aa-12ceb67e37ae was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:01:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:29 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d Nov 05 11:01:29 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Created reservations ['703005e8-a89e-4b25-99ef-bb625ad820bf'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:30 devstack sudo[98564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:30 devstack sudo[98564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:30 devstack sudo[98564]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.319s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:30 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:30 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4104b2db-1526-4a4c-b0d6-022b6962ddd7 tempest-GroupsTest-1505258122 None] Delete group completed successfully. Nov 05 11:01:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-740dbe39-9f43-4552-ab37-adf6bdd69091 tempest-GroupsTest-1505258122 None] Group tempest-GroupsTest-Group-1542063036: creating Nov 05 11:01:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-740dbe39-9f43-4552-ab37-adf6bdd69091 tempest-GroupsTest-1505258122 None] Group tempest-GroupsTest-Group-1542063036: created successfully Nov 05 11:01:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-740dbe39-9f43-4552-ab37-adf6bdd69091 tempest-GroupsTest-1505258122 None] Create group completed successfully. Nov 05 11:01:32 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" returned: 0 in 2.780s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:32 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_sjc54st2devstack@QuobyteHD, size 112.00 MB, duration 2.78 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:01:32 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Converted 112.00 MB image at 40.27 MB/s Nov 05 11:01:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:32 devstack sudo[98575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1G Nov 05 11:01:32 devstack sudo[98575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:33 devstack sudo[98575]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 1G" returned: 0 in 0.418s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Downloaded image d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae for user 5b4ee903abe84d18a914ae0bef483fb6 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Marking volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Copying metadata from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae to 4aed3cdb-c4d0-4353-8f1e-df8042abef3d. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Creating volume glance metadata for volume 4aed3cdb-c4d0-4353-8f1e-df8042abef3d backed by image d8cb4abc-43bb-420e-94aa-12ceb67e37ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcf1d399-34a4-4f63-9766-faccdb474ae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f9e59a-63d6-4238-9215-85d0832f6533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:33 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Volume volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d (4aed3cdb-c4d0-4353-8f1e-df8042abef3d): created successfully Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24f9e59a-63d6-4238-9215-85d0832f6533) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Flow 'volume_create_manager' (c19fbcab-6a1b-4f7d-aa9d-347e8afff23f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2ac1d851-a34b-4b6b-ba0f-bffd61c7a1e8 tempest-VolumesExtendTest-499962101 None] Created volume successfully. Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4ebf51-a4b2-4479-9eef-16f4a7b5ecdb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:33 devstack sudo[98581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d Nov 05 11:01:33 devstack sudo[98581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:34 devstack sudo[98581]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" returned: 0 in 0.677s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 2G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (70ee2bbf-87e2-41fd-bcfa-e3aba029c468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14c51dd-fbb7-4b1c-a121-070eb7bc300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d14c51dd-fbb7-4b1c-a121-070eb7bc300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358790730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,host='devstack@QuobyteHD#QuobyteHD',id=b44aab7c-766c-4093-aef0-617a09b3a5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:34Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a47d24-609d-49d4-ab20-deededf635ba),volume_type_id=f9a47d24-609d-49d4-ab20-deededf635ba)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ebbca-54d0-498f-901f-2b84cd641e45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef8ebbca-54d0-498f-901f-2b84cd641e45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e8e5e2-87f8-457c-8227-d2b9d7328975) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36e8e5e2-87f8-457c-8227-d2b9d7328975) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b44aab7c-766c-4093-aef0-617a09b3a5b1', 'volume_name': 'volume-b44aab7c-766c-4093-aef0-617a09b3a5b1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f35a122-bddb-4de0-9e94-930844674459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f35a122-bddb-4de0-9e94-930844674459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc93116f-54c7-4f39-8945-09937d5a0454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:34 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Volume b44aab7c-766c-4093-aef0-617a09b3a5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b44aab7c-766c-4093-aef0-617a09b3a5b1', 'volume_size': 1} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d 2G" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.037s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,created_at=2026-11-05T10:01:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-358790730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,host='devstack@QuobyteHD#QuobyteHD',id=b44aab7c-766c-4093-aef0-617a09b3a5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:34Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a47d24-609d-49d4-ab20-deededf635ba),volume_type_id=f9a47d24-609d-49d4-ab20-deededf635ba)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Creating volume b44aab7c-766c-4093-aef0-617a09b3a5b1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:34 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:34 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 1073741824 Nov 05 11:01:34 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8310c87e-5772-45df-a965-043c113620c6 tempest-VolumesExtendTest-499962101 None] Extend volume completed successfully. Nov 05 11:01:35 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 1073741824" returned: 0 in 0.561s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:35 devstack sudo[98618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 Nov 05 11:01:35 devstack sudo[98618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:35 devstack sudo[98618]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc93116f-54c7-4f39-8945-09937d5a0454) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b44aab7c-766c-4093-aef0-617a09b3a5b1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7aa8b02-0c8c-49ac-95dc-af1a8fc59da1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Volume volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 (b44aab7c-766c-4093-aef0-617a09b3a5b1): created successfully Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7aa8b02-0c8c-49ac-95dc-af1a8fc59da1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (70ee2bbf-87e2-41fd-bcfa-e3aba029c468) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f491d4ad-f25e-4657-8914-8503d3b9b0b0 tempest-GroupsTest-1505258122 None] Created volume successfully. Nov 05 11:01:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-70a3f0ec-e665-4684-abdc-6293ec33a908 req-d3329b88-e9dc-43e5-988e-40c788a85b72 tempest-TestInstancesWithCinderVolumes-810213748 None] Terminate volume connection completed successfully. Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-70a3f0ec-e665-4684-abdc-6293ec33a908 req-d3329b88-e9dc-43e5-988e-40c788a85b72 tempest-TestInstancesWithCinderVolumes-810213748 None] Deleting attachment 920e6001-bb3c-48d6-b190-39b9496f6a85. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-4aed3cdb-c4d0-4353-8f1e-df8042abef3d-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "cinder-4aed3cdb-c4d0-4353-8f1e-df8042abef3d-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-quobyte-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd048160-96c4-40ad-8055-3d267c4c1a9a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:36 devstack sudo[98623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d Nov 05 11:01:36 devstack sudo[98623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-9af17a75-084d-4d08-89e1-7258ae1e677a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-9af17a75-084d-4d08-89e1-7258ae1e677a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:37 devstack sudo[98623]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" returned: 0 in 0.511s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:37 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d Nov 05 11:01:37 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-quobyte-9af17a75-084d-4d08-89e1-7258ae1e677a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-9af17a75-084d-4d08-89e1-7258ae1e677a" acquired by "delete_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75dd20f-5a37-443b-b215-730a3bd72fd7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:37 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a Nov 05 11:01:37 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:37 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" returned: 0 in 0.351s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-4aed3cdb-c4d0-4353-8f1e-df8042abef3d" released by "delete_volume" :: held 0.949s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Created reservations ['5391b017-65ee-4523-83be-1f56af3dc230', 'b6fbc24f-f581-4fca-9a0d-826ffca4489b', '756eb990-ea76-4bb2-af88-8ea3f4879b42', 'c2c25a4f-f6bb-4e35-8193-da05e766a7bb'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:37 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:37 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:37 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a" returned: 0 in 0.573s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:37 devstack sudo[98645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a Nov 05 11:01:37 devstack sudo[98645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:38 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.456s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:38 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Deleted volume successfully. Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-386ef90c-718c-4482-a1c1-11edf4bc0d3e tempest-VolumesExtendTest-499962101 None] Lock "cinder-4aed3cdb-c4d0-4353-8f1e-df8042abef3d-delete_volume" released by "delete_volume" :: held 1.832s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (85facaa2-8132-4b97-a5ac-b524175610ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:38 devstack sudo[98645]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e87af0f-3c21-4bc1-ac5b-e32fc6e76dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9af17a75-084d-4d08-89e1-7258ae1e677a" returned: 0 in 0.593s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-9af17a75-084d-4d08-89e1-7258ae1e677a" released by "delete_volume" :: held 1.251s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e87af0f-3c21-4bc1-ac5b-e32fc6e76dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735780856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,host='devstack@QuobyteHD#QuobyteHD',id=9047b096-7c87-44a4-911a-5a07382ee0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:38Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a47d24-609d-49d4-ab20-deededf635ba),volume_type_id=f9a47d24-609d-49d4-ab20-deededf635ba)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d584b69d-6651-4ad9-b149-8b9e37fbc2b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d584b69d-6651-4ad9-b149-8b9e37fbc2b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c67e54-92c6-48c2-b672-2f2b20f3d78d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61c67e54-92c6-48c2-b672-2f2b20f3d78d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9047b096-7c87-44a4-911a-5a07382ee0e2', 'volume_name': 'volume-9047b096-7c87-44a4-911a-5a07382ee0e2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a84158-f8f0-424d-955f-be69ecd02b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7a84158-f8f0-424d-955f-be69ecd02b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dc76fb-dcd9-41a2-9189-fbf701b5ca78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:38 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Volume 9047b096-7c87-44a4-911a-5a07382ee0e2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9047b096-7c87-44a4-911a-5a07382ee0e2', 'volume_size': 1} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,created_at=2026-11-05T10:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-735780856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=649d8ac3-f123-4fe7-af13-13c268f9b36a,host='devstack@QuobyteHD#QuobyteHD',id=9047b096-7c87-44a4-911a-5a07382ee0e2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='031e4190338d4c108942cfed93ab88f6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:38Z,use_quota=True,user_id='bcefceefbe454975a05266c3417229c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f9a47d24-609d-49d4-ab20-deededf635ba),volume_type_id=f9a47d24-609d-49d4-ab20-deededf635ba)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Creating volume 9047b096-7c87-44a4-911a-5a07382ee0e2 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:38 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:38 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 1073741824 Nov 05 11:01:38 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:38 devstack cinder-volume[87369]: WARNING cinder.quota [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109962187-620581657 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109962187-620581657, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:38 devstack cinder-volume[87369]: WARNING cinder.quota [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109962187-620581657 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-109962187-620581657, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Created reservations ['fade9d99-2406-4729-b04c-5f0a117a7e32', '679fe109-d57b-4d5b-81d2-490648f6f4a1', '583ae8ae-8dce-400e-b0eb-99b6c541f0e2', 'bd45ab46-e14b-4ac5-963c-598a861d5177'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:38 devstack sudo[98651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:38 devstack sudo[98651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:39 devstack sudo[98651]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Deleted volume successfully. Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e75278a9-1bfa-4b86-9d11-a0808c5b70c6 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-9af17a75-084d-4d08-89e1-7258ae1e677a-delete_volume" released by "delete_volume" :: held 2.179s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:39 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 1073741824" returned: 0 in 0.817s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:39 devstack sudo[98657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 Nov 05 11:01:39 devstack sudo[98657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:39 devstack sudo[98657]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2" returned: 0 in 0.514s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] <== create_volume: return (1415ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57dc76fb-dcd9-41a2-9189-fbf701b5ca78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9047b096-7c87-44a4-911a-5a07382ee0e2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab103865-696f-40c8-9a52-851d3fa01e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Flow 'volume_create_manager' (541f285c-2960-44a7-8623-682965c08fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa83037-e15e-40c7-9e34-a524e9a9da44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Volume volume-9047b096-7c87-44a4-911a-5a07382ee0e2 (9047b096-7c87-44a4-911a-5a07382ee0e2): created successfully Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab103865-696f-40c8-9a52-851d3fa01e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Flow 'volume_create_manager' (85facaa2-8132-4b97-a5ac-b524175610ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5aa83037-e15e-40c7-9e34-a524e9a9da44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1409575089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196164e8-0968-4fd0-9198-7284b4689626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46968dc24f38429e91aee8658ba9bc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:40Z,use_quota=True,user_id='5b4ee903abe84d18a914ae0bef483fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cefa2f9-45aa-4201-a7c9-86b6c6936bec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cefa2f9-45aa-4201-a7c9-86b6c6936bec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c981dcaa-4d98-49ec-a6be-4bf6d3a033f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c981dcaa-4d98-49ec-a6be-4bf6d3a033f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '196164e8-0968-4fd0-9198-7284b4689626', 'volume_name': 'volume-196164e8-0968-4fd0-9198-7284b4689626', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb4b6-f8c9-4bfc-90d4-c3fac6c6148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9acb4b6-f8c9-4bfc-90d4-c3fac6c6148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094164ee-3d92-4819-adc0-ad5d3f91f1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Volume 196164e8-0968-4fd0-9198-7284b4689626: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-196164e8-0968-4fd0-9198-7284b4689626', 'volume_size': 1} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:01:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1409575089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=196164e8-0968-4fd0-9198-7284b4689626,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='46968dc24f38429e91aee8658ba9bc40',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:01:40Z,use_quota=True,user_id='5b4ee903abe84d18a914ae0bef483fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Creating volume 196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:01:40 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-832f04ba-b093-4830-8dc3-cb46a851a0d2 tempest-GroupsTest-1505258122 None] Created volume successfully. Nov 05 11:01:40 devstack sudo[98660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 1073741824 Nov 05 11:01:40 devstack sudo[98660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:40 devstack sudo[98660]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 1073741824" returned: 0 in 0.708s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:40 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:40 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2b5b53fd-3105-4f79-afa1-a82dbcd8a5cd tempest-GroupsTest-1505258122 None] Update group completed successfully. Nov 05 11:01:41 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] <== create_volume: return (1224ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (094164ee-3d92-4819-adc0-ad5d3f91f1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-196164e8-0968-4fd0-9198-7284b4689626', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a427e3ad-6756-44aa-9f3f-5eceeaa9ad0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:01:41 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Volume volume-196164e8-0968-4fd0-9198-7284b4689626 (196164e8-0968-4fd0-9198-7284b4689626): created successfully Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a427e3ad-6756-44aa-9f3f-5eceeaa9ad0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:01:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Flow 'volume_create_manager' (541f285c-2960-44a7-8623-682965c08fc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:01:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-11a837d1-01ed-4053-91ac-6146cf20e991 tempest-VolumesExtendTest-499962101 None] Created volume successfully. Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Creating offline snapshot 1be6072e-69e5-4fc2-9241-d46eed3551b5 of volume 196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[703689db-4033-420e-bd1c-a42d72c47361]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:42 devstack sudo[98690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:42 devstack sudo[98690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-1fb6c803-7d15-4e56-809b-c9619d6d69c2 req-08e37d4b-9c4c-4750-b4cb-e7c92164c4ae tempest-TestInstancesWithCinderVolumes-810213748 None] Terminate volume connection completed successfully. Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-1fb6c803-7d15-4e56-809b-c9619d6d69c2 req-08e37d4b-9c4c-4750-b4cb-e7c92164c4ae tempest-TestInstancesWithCinderVolumes-810213748 None] Deleting attachment 54b53f11-de1b-48f4-b3ab-259767fbd84b. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:01:42 devstack sudo[98690]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.595s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:42 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 1G Nov 05 11:01:42 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f99003e4-8244-4de0-beae-efc18042ee14 tempest-GroupsTest-1505258122 None] Update group completed successfully. Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-208dc6b9-f194-441f-8496-a58d6d00299b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-208dc6b9-f194-441f-8496-a58d6d00299b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-quobyte-208dc6b9-f194-441f-8496-a58d6d00299b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-208dc6b9-f194-441f-8496-a58d6d00299b" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dc50758-e5b1-42d1-849e-46f25b707a56]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:43 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b Nov 05 11:01:43 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:43 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 1G" returned: 0 in 0.677s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196164e8-0968-4fd0-9198-7284b4689626 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:43 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196164e8-0968-4fd0-9198-7284b4689626 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 Nov 05 11:01:43 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:43 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:43 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b" returned: 0 in 0.671s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-196164e8-0968-4fd0-9198-7284b4689626 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5" returned: 0 in 0.470s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:44 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 is being set with open permissions: ugo+rw Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:44 devstack sudo[98713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b Nov 05 11:01:44 devstack sudo[98713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:44 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 Nov 05 11:01:44 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:44 devstack sudo[98713]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-208dc6b9-f194-441f-8496-a58d6d00299b" returned: 0 in 0.512s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-208dc6b9-f194-441f-8496-a58d6d00299b" released by "delete_volume" :: held 1.268s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:44 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5" returned: 0 in 0.531s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:44 devstack cinder-volume[87369]: WARNING cinder.quota [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-465041021-1549659955 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-465041021-1549659955, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:44 devstack cinder-volume[87369]: WARNING cinder.quota [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-465041021-1549659955 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-465041021-1549659955, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:44 devstack sudo[98719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info Nov 05 11:01:44 devstack sudo[98719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Created reservations ['c80ca921-86f4-4619-9bb5-ee47f2ef391f', '97c28bd0-16ca-43b2-bfa6-ff9445527908', '53896988-b313-4394-93d8-1f28352416e8', '45363fc4-a393-4d3f-a3a0-d986433e2ab8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:44 devstack sudo[98721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:44 devstack sudo[98721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:45 devstack sudo[98719]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:45 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info is being set with open permissions: ugo+rw Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:45 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info Nov 05 11:01:45 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Acquiring lock "cinder-quobyte-9047b096-7c87-44a4-911a-5a07382ee0e2" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:45 devstack sudo[98721]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.529s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Deleted volume successfully. Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-9047b096-7c87-44a4-911a-5a07382ee0e2" acquired by "delete_volume" :: waited 0.086s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[55bcda4c-820f-4899-9d00-c598723696a6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5be70025-e4e2-40e7-a931-15739d224e48 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-208dc6b9-f194-441f-8496-a58d6d00299b-delete_volume" released by "delete_volume" :: held 2.453s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:45 devstack sudo[98729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 Nov 05 11:01:45 devstack sudo[98729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:45 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.info" returned: 0 in 0.702s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.734s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1834518a-1d88-4629-b014-60cac91363ad tempest-VolumesExtendTest-499962101 None] Create snapshot completed successfully Nov 05 11:01:46 devstack sudo[98729]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2" returned: 0 in 0.633s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:46 devstack sudo[98735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2 Nov 05 11:01:46 devstack sudo[98735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:46 devstack sudo[98735]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9047b096-7c87-44a4-911a-5a07382ee0e2" returned: 0 in 0.392s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-9047b096-7c87-44a4-911a-5a07382ee0e2" released by "delete_volume" :: held 1.150s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Acquiring lock "cinder-quobyte-b44aab7c-766c-4093-aef0-617a09b3a5b1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-b44aab7c-766c-4093-aef0-617a09b3a5b1" acquired by "delete_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c53736f-fc91-43c6-a146-63d9681747cf]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3408978a-8e6f-475e-903b-ad4182c57458]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:46 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 Nov 05 11:01:46 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:47 devstack sudo[98739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:47 devstack sudo[98739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:47 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1" returned: 0 in 0.690s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:47 devstack sudo[98748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1 Nov 05 11:01:47 devstack sudo[98739]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:47 devstack sudo[98748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.627s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 2G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 2G" returned: 0 in 0.243s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.966s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:47 devstack sudo[98748]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b44aab7c-766c-4093-aef0-617a09b3a5b1" returned: 0 in 0.358s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "cinder-quobyte-b44aab7c-766c-4093-aef0-617a09b3a5b1" released by "delete_volume" :: held 1.134s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4dc4238c-6071-4132-86ca-877938243dd1 tempest-VolumesExtendTest-499962101 None] Extend volume completed successfully. Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Created reservations ['3903bfa9-aa74-4b9d-bf4b-5ec5c20cb036'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:48 devstack cinder-volume[87369]: WARNING cinder.quota [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-166124218 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-166124218, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:48 devstack cinder-volume[87369]: WARNING cinder.quota [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-166124218 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-166124218, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Created reservations ['d08c0501-19d1-4b57-bb20-6eb4ab248c40', '605bb976-ff0e-4ade-ad88-0fdff5d5ec82', '414f0c44-782c-4b41-a69e-daa2fa6c72c4', '11447aea-35eb-4491-a33f-1a74780d49dd'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Created reservations ['51a35b43-f798-46ff-a7b7-8cf9a61623f2', 'fabc36ad-dc36-47cf-bc3d-780864e6cbcf', 'e3f555ac-7198-4a3e-9335-30bbf288a04b', '1f53be56-c1a3-4639-b22d-28b38f34039b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:48 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:48 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:49 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-47469d68-a274-4907-a122-37d7cf40af2b tempest-GroupsTest-1505258122 None] Delete group completed successfully. Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-1be6072e-69e5-4fc2-9241-d46eed3551b5-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-1be6072e-69e5-4fc2-9241-d46eed3551b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-quobyte-1be6072e-69e5-4fc2-9241-d46eed3551b5" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-1be6072e-69e5-4fc2-9241-d46eed3551b5" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Deleting offline snapshot 1be6072e-69e5-4fc2-9241-d46eed3551b5 of volume 196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] snapshot_file for this snap is: volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e4a8b29-cb22-4690-a5f9-8a3ed6579c87]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:49 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 Nov 05 11:01:49 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-947fcfad-40a9-48e4-9e22-1660928d0475 req-fc9d376f-be1b-480c-9cbb-ed31d37e0888 tempest-TestInstancesWithCinderVolumes-810213748 None] Terminate volume connection completed successfully. Nov 05 11:01:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-947fcfad-40a9-48e4-9e22-1660928d0475 req-fc9d376f-be1b-480c-9cbb-ed31d37e0888 tempest-TestInstancesWithCinderVolumes-810213748 None] Deleting attachment 90e2a01f-2d35-42c0-a225-af8c37859a12. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:01:50 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5" returned: 0 in 0.589s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-196164e8-0968-4fd0-9198-7284b4689626(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c07c2e0-a5a6-4804-916e-3ccab087f928]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:50 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:50 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:50 devstack sudo[98796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:50 devstack sudo[98796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:50 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.493s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:01:50 devstack sudo[98796]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.708s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:50 devstack sudo[98805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 Nov 05 11:01:50 devstack sudo[98805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-ef4b74b2-b45d-462f-a632-fcbcede6b380-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-ef4b74b2-b45d-462f-a632-fcbcede6b380-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "cinder-quobyte-ef4b74b2-b45d-462f-a632-fcbcede6b380" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-ef4b74b2-b45d-462f-a632-fcbcede6b380" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[39cc2215-916a-49e0-b0c4-6d330980df02]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:51 devstack sudo[98805]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5" returned: 0 in 0.578s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:51 devstack sudo[98811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5 Nov 05 11:01:51 devstack sudo[98811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:51 devstack sudo[98810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 Nov 05 11:01:51 devstack sudo[98810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:51 devstack sudo[98811]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626.1be6072e-69e5-4fc2-9241-d46eed3551b5" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-1be6072e-69e5-4fc2-9241-d46eed3551b5" released by "_delete_snapshot" :: held 2.502s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" released by "delete_snapshot" :: held 2.534s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:51 devstack sudo[98810]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380" returned: 0 in 0.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:51 devstack sudo[98819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380 Nov 05 11:01:51 devstack sudo[98819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Created reservations ['58d059a8-6bc4-423a-a780-dfc72213e432', 'ecfd3b45-49c5-4107-84ec-35ca2123fe0b', '4d57f7d6-d2c3-4a18-bef7-ac90fb80896c', 'f791c64d-7f26-4769-9ab8-cf94cc364a5e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Delete snapshot completed successfully. Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ef9a38e-6ba8-4a30-aec4-592088588696 tempest-VolumesExtendTest-499962101 None] Lock "cinder-1be6072e-69e5-4fc2-9241-d46eed3551b5-delete_snapshot" released by "delete_snapshot" :: held 2.736s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:52 devstack sudo[98819]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ef4b74b2-b45d-462f-a632-fcbcede6b380" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-quobyte-ef4b74b2-b45d-462f-a632-fcbcede6b380" released by "delete_volume" :: held 0.983s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:52 devstack cinder-volume[87369]: WARNING cinder.quota [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-477305141-1148219098 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-477305141-1148219098, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:52 devstack cinder-volume[87369]: WARNING cinder.quota [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-477305141-1148219098 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-477305141-1148219098, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Created reservations ['4d9d821d-a19c-4562-a9fa-b9d2b2779860', 'adf16868-9848-4d0c-9549-d4b44100ce1d', '3717e6e9-2d35-4b81-bdd6-793d77854093', '546c8b34-5969-4131-84f4-03358629c9d1'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:52 devstack sudo[98831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:52 devstack sudo[98831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-196164e8-0968-4fd0-9198-7284b4689626-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "cinder-196164e8-0968-4fd0-9198-7284b4689626-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Acquiring lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:01:52 devstack sudo[98831]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Deleted volume successfully. Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab08fe05-b2d6-4e2e-b4b0-d0a378c59f35]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:01:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-381896d8-874f-4001-b706-a46f6b676c75 tempest-TestInstancesWithCinderVolumes-810213748 None] Lock "cinder-ef4b74b2-b45d-462f-a632-fcbcede6b380-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:53 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:53 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:53 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:53 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626 Nov 05 11:01:53 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:53 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-196164e8-0968-4fd0-9198-7284b4689626" returned: 0 in 0.324s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "cinder-quobyte-196164e8-0968-4fd0-9198-7284b4689626" released by "delete_volume" :: held 0.975s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:01:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Created reservations ['eeb2a4e6-2a04-499b-a5e2-4f63c7d73359', 'dff90e9a-66f2-4940-b9dc-035983254097', 'd4d3be42-28d0-453d-bee9-9c7d84f9cce6', 'b0725212-8cbd-4891-8b4d-2fcc73b4e154'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:01:54 devstack sudo[98847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:01:54 devstack sudo[98847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:01:54 devstack sudo[98847]: pam_unix(sudo:session): session closed for user root Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:01:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Deleted volume successfully. Nov 05 11:01:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7356340-31f6-472e-bfec-bf7bd9c7b238 tempest-VolumesExtendTest-499962101 None] Lock "cinder-196164e8-0968-4fd0-9198-7284b4689626-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b6a95009-3584-4ad2-a303-1e46b157e16e tempest-GroupsV320Test-543488437 None] Group tempest-GroupsV320Test-Group-161508693: creating Nov 05 11:02:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b6a95009-3584-4ad2-a303-1e46b157e16e tempest-GroupsV320Test-543488437 None] Group tempest-GroupsV320Test-Group-161508693: created successfully Nov 05 11:02:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b6a95009-3584-4ad2-a303-1e46b157e16e tempest-GroupsV320Test-543488437 None] Create group completed successfully. Nov 05 11:02:02 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Created reservations ['85a25631-992a-41f5-87fd-f6419b7b84d4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:03 devstack sudo[98925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:03 devstack sudo[98925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:03 devstack sudo[98925]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.586s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:03 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1a6ef961-96b2-4e85-b37c-101ff90ff210 tempest-GroupsV320Test-543488437 None] Delete group completed successfully. Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (2fd65351-60ef-4210-81dd-2aa23d95217e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ecab1-0e10-465e-a1b4-4b692386947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (968ecab1-0e10-465e-a1b4-4b692386947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-739093227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4802ac71-22ac-4382-9394-93ea585a8fe7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:04Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406e8315-24b3-4cea-b7db-748b0919f058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (406e8315-24b3-4cea-b7db-748b0919f058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff20ad-79a7-45db-8406-f2580a282f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dff20ad-79a7-45db-8406-f2580a282f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4802ac71-22ac-4382-9394-93ea585a8fe7', 'volume_name': 'volume-4802ac71-22ac-4382-9394-93ea585a8fe7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80aaff0-1803-44fb-a69e-4e83c7a80d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b80aaff0-1803-44fb-a69e-4e83c7a80d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f3ea43-6b2f-406d-87a8-9b89bac5c9d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:04 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Volume 4802ac71-22ac-4382-9394-93ea585a8fe7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4802ac71-22ac-4382-9394-93ea585a8fe7', 'volume_size': 1} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-739093227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4802ac71-22ac-4382-9394-93ea585a8fe7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:04Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Creating volume 4802ac71-22ac-4382-9394-93ea585a8fe7 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:04 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:04 devstack sudo[98929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 1073741824 Nov 05 11:02:04 devstack sudo[98929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:05 devstack sudo[98929]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 1073741824" returned: 0 in 1.035s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:05 devstack sudo[98940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 Nov 05 11:02:05 devstack sudo[98940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:06 devstack sudo[98940]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7" returned: 0 in 0.529s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f3ea43-6b2f-406d-87a8-9b89bac5c9d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4802ac71-22ac-4382-9394-93ea585a8fe7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9608be-78cf-4759-aaa9-3380f09ff282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:06 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Volume volume-4802ac71-22ac-4382-9394-93ea585a8fe7 (4802ac71-22ac-4382-9394-93ea585a8fe7): created successfully Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b9608be-78cf-4759-aaa9-3380f09ff282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (2fd65351-60ef-4210-81dd-2aa23d95217e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2145b182-3f21-401f-826d-ad905a0b3503 tempest-VolumesListTestJSON-1288003912 None] Created volume successfully. Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=169,cinder:SELECT=145,cinder:INSERT=43,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (f9e86694-dce2-44df-aa05-7cd15d8aba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d077f733-fa73-47f7-a972-7e556e7f35e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d077f733-fa73-47f7-a972-7e556e7f35e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-349245053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1776554-9bbd-46a9-8513-a28e92079bd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:08Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ecd84-d64c-47a7-9115-90eb20c1aff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (204ecd84-d64c-47a7-9115-90eb20c1aff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6d9a37-12b2-415b-a423-4a8b1bfde6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e6d9a37-12b2-415b-a423-4a8b1bfde6bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1776554-9bbd-46a9-8513-a28e92079bd8', 'volume_name': 'volume-a1776554-9bbd-46a9-8513-a28e92079bd8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c79e39-fa81-47ec-845f-fc305716c7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c79e39-fa81-47ec-845f-fc305716c7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cdb53f-a03f-4611-9a72-e0d9d3ee14a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:07 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Volume a1776554-9bbd-46a9-8513-a28e92079bd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1776554-9bbd-46a9-8513-a28e92079bd8', 'volume_size': 1} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-349245053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1776554-9bbd-46a9-8513-a28e92079bd8,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:08Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Creating volume a1776554-9bbd-46a9-8513-a28e92079bd8 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:07 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:07 devstack sudo[98962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 1073741824 Nov 05 11:02:07 devstack sudo[98962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:08 devstack sudo[98962]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 1073741824" returned: 0 in 0.684s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:08 devstack sudo[98968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 Nov 05 11:02:08 devstack sudo[98968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:08 devstack sudo[98968]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8" returned: 0 in 0.324s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1cdb53f-a03f-4611-9a72-e0d9d3ee14a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1776554-9bbd-46a9-8513-a28e92079bd8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c091e2fc-d6ca-405a-8e3d-5e2ec2a30e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:08 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Volume volume-a1776554-9bbd-46a9-8513-a28e92079bd8 (a1776554-9bbd-46a9-8513-a28e92079bd8): created successfully Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c091e2fc-d6ca-405a-8e3d-5e2ec2a30e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (f9e86694-dce2-44df-aa05-7cd15d8aba94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:08 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4a9954a6-b7db-44d0-a4a0-270ce0316d82 tempest-VolumesListTestJSON-1288003912 None] Created volume successfully. Nov 05 11:02:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:INSERT=39,cinder:SELECT=146,cinder:UPDATE=156,cinder:DELETE=13 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:02:10 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (7ff67208-f4aa-48cc-ba17-f0b7438f7c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da227948-9932-4249-b9bb-d97717dbb1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da227948-9932-4249-b9bb-d97717dbb1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-391632274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03ec564-a375-4ee8-89f9-9a3984896566,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:11Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563d879b-ec92-4492-b1e8-1c014d26ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (563d879b-ec92-4492-b1e8-1c014d26ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86012fbb-5e2d-419b-bc1b-1c38f047a2c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86012fbb-5e2d-419b-bc1b-1c38f047a2c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd03ec564-a375-4ee8-89f9-9a3984896566', 'volume_name': 'volume-d03ec564-a375-4ee8-89f9-9a3984896566', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e152e7-89a4-45a8-be00-5de3219a6402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e152e7-89a4-45a8-be00-5de3219a6402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a2c0bf-b565-47aa-8245-5b574535c0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:11 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Volume d03ec564-a375-4ee8-89f9-9a3984896566: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d03ec564-a375-4ee8-89f9-9a3984896566', 'volume_size': 1} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-391632274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d03ec564-a375-4ee8-89f9-9a3984896566,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='9e90aef7b05f494cba0447413bc97ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:11Z,use_quota=True,user_id='5262bea116a340df929f1eea825fa7f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Creating volume d03ec564-a375-4ee8-89f9-9a3984896566 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:11 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:11 devstack sudo[98971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 1073741824 Nov 05 11:02:11 devstack sudo[98971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:11 devstack sudo[98971]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 1073741824" returned: 0 in 0.621s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:11 devstack sudo[98978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 Nov 05 11:02:11 devstack sudo[98978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:12 devstack sudo[98978]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] <== create_volume: return (1122ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8a2c0bf-b565-47aa-8245-5b574535c0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d03ec564-a375-4ee8-89f9-9a3984896566', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af50627-ff1f-4a66-98e4-d9116fa92123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:12 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Volume volume-d03ec564-a375-4ee8-89f9-9a3984896566 (d03ec564-a375-4ee8-89f9-9a3984896566): created successfully Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8af50627-ff1f-4a66-98e4-d9116fa92123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Flow 'volume_create_manager' (7ff67208-f4aa-48cc-ba17-f0b7438f7c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-44e85f6e-b59f-4f72-ad71-6b9184274d8b tempest-VolumesListTestJSON-1288003912 None] Created volume successfully. Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-d03ec564-a375-4ee8-89f9-9a3984896566-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-d03ec564-a375-4ee8-89f9-9a3984896566-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-quobyte-d03ec564-a375-4ee8-89f9-9a3984896566" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-d03ec564-a375-4ee8-89f9-9a3984896566" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1226bb27-4357-49e7-8b43-1dfce730fcc4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:17 devstack sudo[99060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 Nov 05 11:02:17 devstack sudo[99060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:18 devstack sudo[99060]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566" returned: 0 in 0.830s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:18 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566 Nov 05 11:02:18 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d03ec564-a375-4ee8-89f9-9a3984896566" returned: 0 in 0.782s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:18 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-d03ec564-a375-4ee8-89f9-9a3984896566" released by "delete_volume" :: held 1.756s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Created reservations ['d2143091-f7c4-4103-82a1-89bf65622196', '9ec3a543-430e-4c94-b954-01374a09ba63', '6356a685-1243-4ade-aadc-ebeb665fe56a', '6478be4d-ede9-4fba-a085-c72aea145c8c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:19 devstack sudo[99124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:19 devstack sudo[99124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-a1776554-9bbd-46a9-8513-a28e92079bd8-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-a1776554-9bbd-46a9-8513-a28e92079bd8-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:20 devstack sudo[99124]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-quobyte-a1776554-9bbd-46a9-8513-a28e92079bd8" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.847s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Deleted volume successfully. Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-a1776554-9bbd-46a9-8513-a28e92079bd8" acquired by "delete_volume" :: waited 0.061s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36f29cef-798e-4e3a-bbf9-bfe63884d49a tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-d03ec564-a375-4ee8-89f9-9a3984896566-delete_volume" released by "delete_volume" :: held 3.365s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6245c6f8-1c59-4d9b-80df-da269a3d6873]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:20 devstack sudo[99145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 Nov 05 11:02:20 devstack sudo[99145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:21 devstack sudo[99145]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8" returned: 0 in 0.922s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:21 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8 Nov 05 11:02:21 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:21 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a1776554-9bbd-46a9-8513-a28e92079bd8" returned: 0 in 0.353s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-a1776554-9bbd-46a9-8513-a28e92079bd8" released by "delete_volume" :: held 1.409s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:21 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Created reservations ['91655c89-e57d-48e3-8973-d5f7b1291c60', 'e03ba861-76c5-46d8-8186-a3d3c6464631', 'c8f7cc3e-04a0-43fa-a241-98f2678a9f07', '60ac9a97-d915-4395-8f79-3af492432176'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:22 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:22 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:22 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Deleted volume successfully. Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-26f7b26e-b37d-4982-9b33-1d66ba4fea2d tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-a1776554-9bbd-46a9-8513-a28e92079bd8-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-4802ac71-22ac-4382-9394-93ea585a8fe7-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-4802ac71-22ac-4382-9394-93ea585a8fe7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "cinder-quobyte-4802ac71-22ac-4382-9394-93ea585a8fe7" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-4802ac71-22ac-4382-9394-93ea585a8fe7" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22203bfc-0aee-4193-bfae-b34008120b48]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:23 devstack sudo[99163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 Nov 05 11:02:23 devstack sudo[99163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:23 devstack sudo[99163]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7" returned: 0 in 0.529s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:23 devstack sudo[99168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7 Nov 05 11:02:23 devstack sudo[99168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:24 devstack sudo[99168]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4802ac71-22ac-4382-9394-93ea585a8fe7" returned: 0 in 0.369s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-quobyte-4802ac71-22ac-4382-9394-93ea585a8fe7" released by "delete_volume" :: held 0.971s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Created reservations ['cac1b18e-c2fc-4e7f-a95a-303e14b6c428', 'b17e1aea-a6af-4f77-aa1b-152f2fb62c6e', '19132679-b1dd-47a0-bf3a-9b899bb76f7a', '2b399167-19fe-4b61-856d-65c7694ac635'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:24 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:24 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Flow 'volume_create_manager' (1f6786b9-8840-4199-9837-1bb0736f7597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a75990b-45c8-4a8f-af70-860e1198ce3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a75990b-45c8-4a8f-af70-860e1198ce3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1498911549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4ca481-7bb1-458b-bc8e-b275ecc9b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d0eeaab6284a89a8e9f98a078728e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:25Z,use_quota=True,user_id='ce5c90dbdf5f46cc8703383886cd031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b32273-7d9b-4d35-a0e3-6c626892d93c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11b32273-7d9b-4d35-a0e3-6c626892d93c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33618122-6de2-4819-9594-7689e6a5683c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33618122-6de2-4819-9594-7689e6a5683c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed4ca481-7bb1-458b-bc8e-b275ecc9b87f', 'volume_name': 'volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b847600-b4a6-4be3-b218-8026532db325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b847600-b4a6-4be3-b218-8026532db325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6460ec1-f4e7-4a61-9423-b97df0ba0551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Volume ed4ca481-7bb1-458b-bc8e-b275ecc9b87f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f', 'volume_size': 1} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1498911549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed4ca481-7bb1-458b-bc8e-b275ecc9b87f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d0eeaab6284a89a8e9f98a078728e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:25Z,use_quota=True,user_id='ce5c90dbdf5f46cc8703383886cd031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Creating volume ed4ca481-7bb1-458b-bc8e-b275ecc9b87f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:24 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:24 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.474s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:24 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f 1073741824 Nov 05 11:02:24 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Deleted volume successfully. Nov 05 11:02:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3ed10977-fa6c-4a73-99be-f25f664ede70 tempest-VolumesListTestJSON-1288003912 None] Lock "cinder-4802ac71-22ac-4382-9394-93ea585a8fe7-delete_volume" released by "delete_volume" :: held 1.947s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:25 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f 1073741824" returned: 0 in 0.772s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:25 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f Nov 05 11:02:25 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:26 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" returned: 0 in 0.398s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.238s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c6460ec1-f4e7-4a61-9423-b97df0ba0551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b7fced-44b2-4b79-819e-14af7d6cf8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:26 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Volume volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f (ed4ca481-7bb1-458b-bc8e-b275ecc9b87f): created successfully Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45b7fced-44b2-4b79-819e-14af7d6cf8be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Flow 'volume_create_manager' (1f6786b9-8840-4199-9837-1bb0736f7597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-45c83f0b-cbd1-4f73-9c2e-a71dd4bb4694 tempest-ServersNegativeTestJSON-708819015 None] Created volume successfully. Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Flow 'volume_create_manager' (03ea5c71-6d28-4d5b-ab0f-a4366207a69d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981f8c71-2b54-4404-a163-38a0f6a607b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (981f8c71-2b54-4404-a163-38a0f6a607b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2023020319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d72adf-1639-4762-904b-65db77c1dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d0eeaab6284a89a8e9f98a078728e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:31Z,use_quota=True,user_id='ce5c90dbdf5f46cc8703383886cd031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6691ad7-a4ba-4d03-a857-5d1fdd00b86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6691ad7-a4ba-4d03-a857-5d1fdd00b86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80036d5d-9792-4583-b39a-771f641ae644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80036d5d-9792-4583-b39a-771f641ae644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39d72adf-1639-4762-904b-65db77c1dabd', 'volume_name': 'volume-39d72adf-1639-4762-904b-65db77c1dabd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef6895-fc34-41bd-b7e1-918268de188d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8ef6895-fc34-41bd-b7e1-918268de188d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e4986b-de9c-4c98-aec8-e219d1b61638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Volume 39d72adf-1639-4762-904b-65db77c1dabd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39d72adf-1639-4762-904b-65db77c1dabd', 'volume_size': 1} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2023020319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39d72adf-1639-4762-904b-65db77c1dabd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d0eeaab6284a89a8e9f98a078728e2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:31Z,use_quota=True,user_id='ce5c90dbdf5f46cc8703383886cd031c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Creating volume 39d72adf-1639-4762-904b-65db77c1dabd {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:30 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:30 devstack sudo[99184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd 1073741824 Nov 05 11:02:30 devstack sudo[99184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:31 devstack sudo[99184]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd 1073741824" returned: 0 in 0.755s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:31 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd Nov 05 11:02:31 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:32 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd" returned: 0 in 0.396s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] <== create_volume: return (1287ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.290s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e4986b-de9c-4c98-aec8-e219d1b61638) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39d72adf-1639-4762-904b-65db77c1dabd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d952ddc1-5cd9-471d-8b2e-309315551867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:32 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Volume volume-39d72adf-1639-4762-904b-65db77c1dabd (39d72adf-1639-4762-904b-65db77c1dabd): created successfully Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d952ddc1-5cd9-471d-8b2e-309315551867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Flow 'volume_create_manager' (03ea5c71-6d28-4d5b-ab0f-a4366207a69d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5afae883-007d-4c0b-afff-0e8eae874975 tempest-ServersNegativeTestJSON-708819015 None] Created volume successfully. Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Flow 'volume_create_manager' (1c0fa5e5-cfe7-4dd5-8da2-fa744be4f659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4940618-1b70-4d85-99fe-f1998be437ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4940618-1b70-4d85-99fe-f1998be437ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2127043570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b01eab-c472-453b-b89c-7b438fc5ae83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3be33ce82944a7b80368c9366515186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:35Z,use_quota=True,user_id='3bf4e7156bfa40c980c3ca1d812399b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86c4f710-8869-4482-be54-4dc0036b6ba3),volume_type_id=86c4f710-8869-4482-be54-4dc0036b6ba3)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06dfbe26-5687-49d0-9cbf-b16740060da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06dfbe26-5687-49d0-9cbf-b16740060da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1c7902-d16a-453d-bc73-943fbd93f96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fa1c7902-d16a-453d-bc73-943fbd93f96d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2b01eab-c472-453b-b89c-7b438fc5ae83', 'volume_name': 'volume-c2b01eab-c472-453b-b89c-7b438fc5ae83', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcdbcc-62cc-4e52-9546-804342d3edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (03dcdbcc-62cc-4e52-9546-804342d3edc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d24fc60-4627-40e4-ac74-9ec248c24530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:34 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Volume c2b01eab-c472-453b-b89c-7b438fc5ae83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2b01eab-c472-453b-b89c-7b438fc5ae83', 'volume_size': 1} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:02:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2127043570',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2b01eab-c472-453b-b89c-7b438fc5ae83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d3be33ce82944a7b80368c9366515186',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:02:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:02:35Z,use_quota=True,user_id='3bf4e7156bfa40c980c3ca1d812399b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(86c4f710-8869-4482-be54-4dc0036b6ba3),volume_type_id=86c4f710-8869-4482-be54-4dc0036b6ba3)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Creating volume c2b01eab-c472-453b-b89c-7b438fc5ae83 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:02:34 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:02:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:34 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 1073741824 Nov 05 11:02:34 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "cinder-39d72adf-1639-4762-904b-65db77c1dabd-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-39d72adf-1639-4762-904b-65db77c1dabd-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "cinder-quobyte-39d72adf-1639-4762-904b-65db77c1dabd" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:35 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-quobyte-39d72adf-1639-4762-904b-65db77c1dabd" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 1073741824" returned: 0 in 0.794s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[88183fe3-1323-4aa4-8bb9-d788a5f74d79]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:35 devstack sudo[99200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 Nov 05 11:02:35 devstack sudo[99200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:35 devstack sudo[99199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd Nov 05 11:02:35 devstack sudo[99199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:36 devstack sudo[99200]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] <== create_volume: return (1321ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.325s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d24fc60-4627-40e4-ac74-9ec248c24530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2b01eab-c472-453b-b89c-7b438fc5ae83', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4e334d-6eec-4d39-b09c-cd631645ab96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:02:36 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Volume volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 (c2b01eab-c472-453b-b89c-7b438fc5ae83): created successfully Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae4e334d-6eec-4d39-b09c-cd631645ab96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Flow 'volume_create_manager' (1c0fa5e5-cfe7-4dd5-8da2-fa744be4f659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:02:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fea24c0a-624a-4ff7-84e0-326f8f492380 tempest-VolumeTypesAccessTest-329173440 None] Created volume successfully. Nov 05 11:02:36 devstack sudo[99199]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd" returned: 0 in 0.628s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:36 devstack sudo[99207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd Nov 05 11:02:36 devstack sudo[99207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:36 devstack sudo[99207]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39d72adf-1639-4762-904b-65db77c1dabd" returned: 0 in 0.408s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-quobyte-39d72adf-1639-4762-904b-65db77c1dabd" released by "delete_volume" :: held 1.123s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:36 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Created reservations ['a3b5cd79-b004-4d65-b451-9dd4f1b5514c', '3261982d-da37-42cc-90e5-870c45bd5a74', '3c43005b-bd47-4cab-80d4-301c43d07500', 'a86c9c0a-fbee-483b-ad1f-0e077b9c57da'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:37 devstack sudo[99210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:37 devstack sudo[99210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Acquiring lock "cinder-c2b01eab-c472-453b-b89c-7b438fc5ae83-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "cinder-c2b01eab-c472-453b-b89c-7b438fc5ae83-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Acquiring lock "cinder-quobyte-c2b01eab-c472-453b-b89c-7b438fc5ae83" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "cinder-quobyte-c2b01eab-c472-453b-b89c-7b438fc5ae83" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1404d78-d560-433b-8664-db7141e867a9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:37 devstack sudo[99210]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Deleted volume successfully. Nov 05 11:02:37 devstack sudo[99212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 Nov 05 11:02:37 devstack sudo[99212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d2c450a-9995-4be5-90b3-2ca2a285aa3a tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-39d72adf-1639-4762-904b-65db77c1dabd-delete_volume" released by "delete_volume" :: held 1.974s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:37 devstack sudo[99212]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83" returned: 0 in 0.531s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "cinder-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:37 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83 Nov 05 11:02:37 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "cinder-quobyte-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-quobyte-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c085db-ee97-4a6a-9ed5-6ed2d0f784ce]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:38 devstack sudo[99222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f Nov 05 11:02:38 devstack sudo[99222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:38 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c2b01eab-c472-453b-b89c-7b438fc5ae83" returned: 0 in 0.490s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "cinder-quobyte-c2b01eab-c472-453b-b89c-7b438fc5ae83" released by "delete_volume" :: held 1.087s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:38 devstack cinder-volume[87369]: WARNING cinder.quota [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1544717027 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1544717027, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:02:38 devstack cinder-volume[87369]: WARNING cinder.quota [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1544717027 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1544717027, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Created reservations ['a02e269e-248c-4688-aa93-2889672d8092', 'cbf5612e-7cfb-4198-9ca5-5da0890d0dbe', '2627bf60-eab6-4a27-921a-fe3195fd069f', '8df6e9a8-efe0-48a2-b45f-081467c5e087'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:38 devstack sudo[99222]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" returned: 0 in 0.612s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:38 devstack sudo[99228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:38 devstack sudo[99228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:38 devstack sudo[99230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f Nov 05 11:02:38 devstack sudo[99230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:38 devstack sudo[99228]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.360s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Deleted volume successfully. Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a3ec6627-54b6-4f1e-8b0d-9374e9862471 tempest-VolumeTypesAccessTest-329173440 None] Lock "cinder-c2b01eab-c472-453b-b89c-7b438fc5ae83-delete_volume" released by "delete_volume" :: held 1.879s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:39 devstack sudo[99230]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" returned: 0 in 0.445s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-quobyte-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f" released by "delete_volume" :: held 1.118s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Created reservations ['75ef2cb4-bd2a-4e78-acd4-9395a90e9518', '2137f3d6-e64d-4aae-9bac-42ad86d22dd6', '61910b21-b64f-4c0c-8f22-9c522568f557', '455ff74e-2084-4705-95c1-236bcbc795ef'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:39 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:39 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:39 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.358s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Deleted volume successfully. Nov 05 11:02:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7a3749a6-8d76-4514-b5dc-44517db4440c tempest-ServersNegativeTestJSON-708819015 None] Lock "cinder-ed4ca481-7bb1-458b-bc8e-b275ecc9b87f-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:02:49 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=60,cinder:INSERT=17,cinder:SELECT=40,cinder:DELETE=7 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:02:49 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=37,cinder:INSERT=12,cinder:UPDATE=61,cinder:DELETE=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:02:50 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:02:50 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:02:50 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:02:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Flow 'volume_create_manager' (956339e1-d66c-4273-bf7f-df42b1da7504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb76967-3568-4405-a9d4-13e83a29b32f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcb76967-3568-4405-a9d4-13e83a29b32f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-998085504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cebfd7-a161-490f-96be-1359d069d0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f3de05d88b4678b74a683c9833f642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:06Z,use_quota=True,user_id='5a1a985dc599445d825f1909e57685d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecac9e3-a8fb-4132-b3a1-26796fc017b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ecac9e3-a8fb-4132-b3a1-26796fc017b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7caf8ae-905a-4e43-9102-041bd7bcd518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:06 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7caf8ae-905a-4e43-9102-041bd7bcd518) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '85cebfd7-a161-490f-96be-1359d069d0e1', 'volume_name': 'volume-85cebfd7-a161-490f-96be-1359d069d0e1', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb0841-8523-436c-9491-6659a3d41f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0eb0841-8523-436c-9491-6659a3d41f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c968d166-6e7b-4d0a-b2c8-6e818a94176c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:07 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Volume 85cebfd7-a161-490f-96be-1359d069d0e1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-85cebfd7-a161-490f-96be-1359d069d0e1', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Trying to clone 85cebfd7-a161-490f-96be-1359d069d0e1 from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:03:07 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Image download 20.69 MB at 20.69 MB/s Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6a9a01-5c0d-4a46-94ab-35ee8525f7a8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01579fff-b7eb-481f-88bf-df267762c784 tempest-BackendsCapabilitiesAdminTestsJSON-130706962 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552612304688, 'free_capacity_gb': 1773.4552612304688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 11:03:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-234905b9-3c93-47b2-a0e8-8025e01c1911 tempest-BackendsCapabilitiesAdminTestsJSON-130706962 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552612304688, 'free_capacity_gb': 1773.4552612304688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 11:03:08 devstack sudo[99279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD Nov 05 11:03:08 devstack sudo[99279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:08 devstack sudo[99279]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD" returned: 0 in 0.537s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae is fetched for user 5a1a985dc599445d825f1909e57685d2. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b2bada-0db0-4fa1-b334-cab4964dae4b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:08 devstack sudo[99285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD Nov 05 11:03:08 devstack sudo[99285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:08 devstack sudo[99285]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-998085504',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85cebfd7-a161-490f-96be-1359d069d0e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='79f3de05d88b4678b74a683c9833f642',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:06Z,use_quota=True,user_id='5a1a985dc599445d825f1909e57685d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Creating volume 85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:03:08 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:03:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:08 devstack sudo[99291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1073741824 Nov 05 11:03:08 devstack sudo[99291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:09 devstack sudo[99291]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1073741824" returned: 0 in 0.628s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:09 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 Nov 05 11:03:09 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:09 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1" returned: 0 in 0.286s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] <== create_volume: return (973ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.977s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Attempting download of d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 85cebfd7-a161-490f-96be-1359d069d0e1. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ebbdf6-8d8b-46a9-a761-9a9cb01b3cd9]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:10 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt Nov 05 11:03:10 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:10 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt" returned: 0 in 0.441s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:10 devstack sudo[99306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt Nov 05 11:03:10 devstack sudo[99306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:10 devstack sudo[99306]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt" returned: 1 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_mhb51evt' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d169d1b7-2319-4bf0-b3bb-48a4cce787c8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:11 devstack sudo[99310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD Nov 05 11:03:11 devstack sudo[99310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:11 devstack sudo[99310]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD" returned: 0 in 0.444s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:11 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] d8cb4abc-43bb-420e-94aa-12ceb67e37ae was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:03:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:11 devstack sudo[99317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 Nov 05 11:03:11 devstack sudo[99317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:14 devstack sudo[99317]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1" returned: 0 in 3.047s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:14 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_35vik8fxdevstack@QuobyteHD, size 112.00 MB, duration 3.05 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:03:14 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Converted 112.00 MB image at 36.74 MB/s Nov 05 11:03:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:14 devstack sudo[99327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1G Nov 05 11:03:14 devstack sudo[99327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:15 devstack sudo[99327]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 1G" returned: 0 in 0.730s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Downloaded image d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 85cebfd7-a161-490f-96be-1359d069d0e1 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae for user 5a1a985dc599445d825f1909e57685d2 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Marking volume 85cebfd7-a161-490f-96be-1359d069d0e1 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Copying metadata from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae to 85cebfd7-a161-490f-96be-1359d069d0e1. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Creating volume glance metadata for volume 85cebfd7-a161-490f-96be-1359d069d0e1 backed by image d8cb4abc-43bb-420e-94aa-12ceb67e37ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c968d166-6e7b-4d0a-b2c8-6e818a94176c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85cebfd7-a161-490f-96be-1359d069d0e1', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e824e5-2274-41f1-b93c-68a1886078e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:15 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Volume volume-85cebfd7-a161-490f-96be-1359d069d0e1 (85cebfd7-a161-490f-96be-1359d069d0e1): created successfully Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42e824e5-2274-41f1-b93c-68a1886078e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Flow 'volume_create_manager' (956339e1-d66c-4273-bf7f-df42b1da7504) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-29eaa40b-02f1-4048-89f4-39048820e228 tempest-TestShelveInstance-1178818745 None] Created volume successfully. Nov 05 11:03:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-44083986-569c-44ed-93bf-444289b83bf8 req-1881f26a-1849-4a79-a7b5-3a0da8951837 tempest-TestShelveInstance-1178818745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-44083986-569c-44ed-93bf-444289b83bf8 req-1881f26a-1849-4a79-a7b5-3a0da8951837 tempest-TestShelveInstance-1178818745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-44083986-569c-44ed-93bf-444289b83bf8 req-1881f26a-1849-4a79-a7b5-3a0da8951837 tempest-TestShelveInstance-1178818745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.037s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-44083986-569c-44ed-93bf-444289b83bf8 req-1881f26a-1849-4a79-a7b5-3a0da8951837 tempest-TestShelveInstance-1178818745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-85cebfd7-a161-490f-96be-1359d069d0e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f13577d2-09d1-4ae5-ade2-2954c32fd6e3', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:03:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-44083986-569c-44ed-93bf-444289b83bf8 req-1881f26a-1849-4a79-a7b5-3a0da8951837 tempest-TestShelveInstance-1178818745 None] attachment_update completed successfully. Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Flow 'volume_create_manager' (3fb0c6f9-fe8d-4fda-9906-a31b29d23ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022c4bd1-dea6-425d-9c51-854119c4c33e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (022c4bd1-dea6-425d-9c51-854119c4c33e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1224137379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d927dc84-a77a-488c-b732-dbf0f83df0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68964417e5b14f729a7cc65b4be32a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:27Z,use_quota=True,user_id='4ea743317eab4607bb550a7c38f33368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071e193-07c2-4a33-b1cc-dd197be10df1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4071e193-07c2-4a33-b1cc-dd197be10df1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbbbab3-5dd7-482e-b848-f195c50559cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cbbbab3-5dd7-482e-b848-f195c50559cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd927dc84-a77a-488c-b732-dbf0f83df0c8', 'volume_name': 'volume-d927dc84-a77a-488c-b732-dbf0f83df0c8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f146874-81b9-4bbb-937f-c5b1b4393d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f146874-81b9-4bbb-937f-c5b1b4393d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2401bb06-848c-4f68-8b56-a2684e903d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Volume d927dc84-a77a-488c-b732-dbf0f83df0c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d927dc84-a77a-488c-b732-dbf0f83df0c8', 'volume_size': 1} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1224137379',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d927dc84-a77a-488c-b732-dbf0f83df0c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68964417e5b14f729a7cc65b4be32a90',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:27Z,use_quota=True,user_id='4ea743317eab4607bb550a7c38f33368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Creating volume d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:03:27 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:27 devstack sudo[99519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 1073741824 Nov 05 11:03:27 devstack sudo[99519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Flow 'volume_create_manager' (2b6c27fc-f093-473c-a239-fbc0a1f79b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41035ec-ac19-4a30-b88e-8d665a032a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e41035ec-ac19-4a30-b88e-8d665a032a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047055075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3f8624-425e-4990-aec3-8546c4cff904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d134405e97f04adaacea7f9f7af40840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:27Z,use_quota=True,user_id='66dd351a561242ee84892aba9a3b8734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b88375a-fa84-405e-9ed7-fdae1f19f151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b88375a-fa84-405e-9ed7-fdae1f19f151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a54e48-5a65-41ae-96e8-b44a5753c769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59a54e48-5a65-41ae-96e8-b44a5753c769) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc3f8624-425e-4990-aec3-8546c4cff904', 'volume_name': 'volume-cc3f8624-425e-4990-aec3-8546c4cff904', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e8f3a4-eb02-47d3-8cd3-8dee3566e20e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27e8f3a4-eb02-47d3-8cd3-8dee3566e20e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e4026-58a8-4a4d-bbf2-63062e86bc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:27 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Volume cc3f8624-425e-4990-aec3-8546c4cff904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc3f8624-425e-4990-aec3-8546c4cff904', 'volume_size': 1} Nov 05 11:03:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:28 devstack sudo[99519]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 1073741824" returned: 0 in 1.044s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:28 devstack sudo[99776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 Nov 05 11:03:28 devstack sudo[99776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:28 devstack sudo[99776]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8" returned: 0 in 0.482s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.328s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2047055075',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc3f8624-425e-4990-aec3-8546c4cff904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d134405e97f04adaacea7f9f7af40840',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:27Z,use_quota=True,user_id='66dd351a561242ee84892aba9a3b8734',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Creating volume cc3f8624-425e-4990-aec3-8546c4cff904 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:03:29 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:29 devstack sudo[99966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 1073741824 Nov 05 11:03:29 devstack sudo[99966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2401bb06-848c-4f68-8b56-a2684e903d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d927dc84-a77a-488c-b732-dbf0f83df0c8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be40e9-50ca-4d3c-a1be-a7627b323156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:29 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Volume volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 (d927dc84-a77a-488c-b732-dbf0f83df0c8): created successfully Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95be40e9-50ca-4d3c-a1be-a7627b323156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Flow 'volume_create_manager' (3fb0c6f9-fe8d-4fda-9906-a31b29d23ee7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d30e3aa9-f273-45c9-bde6-c794a90c614a tempest-SnapshotMetadataTestJSON-853497649 None] Created volume successfully. Nov 05 11:03:29 devstack sudo[99966]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 1073741824" returned: 0 in 0.926s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:30 devstack sudo[99989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 Nov 05 11:03:30 devstack sudo[99989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:30 devstack sudo[99989]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904" returned: 0 in 0.561s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce7e4026-58a8-4a4d-bbf2-63062e86bc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc3f8624-425e-4990-aec3-8546c4cff904', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090fd922-a8f4-4e0d-981a-ca342a6d23c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Volume volume-cc3f8624-425e-4990-aec3-8546c4cff904 (cc3f8624-425e-4990-aec3-8546c4cff904): created successfully Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (090fd922-a8f4-4e0d-981a-ca342a6d23c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Flow 'volume_create_manager' (2b6c27fc-f093-473c-a239-fbc0a1f79b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:30 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fee0be04-4a57-45fc-b252-745a19697d68 tempest-TestMinimumBasicScenario-504918328 None] Created volume successfully. Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Creating offline snapshot 1cb85ae7-f2cd-484d-92cf-2abf3ad75550 of volume d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ac440b-24e3-4628-9742-8943a28040f6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:31 devstack sudo[99992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 Nov 05 11:03:31 devstack sudo[99992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:31 devstack sudo[99992]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8" returned: 0 in 0.901s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:31 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 1G Nov 05 11:03:31 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:32 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 1G" returned: 0 in 0.898s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:32 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 Nov 05 11:03:32 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:33 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550" returned: 0 in 0.635s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:33 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 is being set with open permissions: ugo+rw Nov 05 11:03:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:33 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 Nov 05 11:03:33 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f42e499b-2727-4ade-a7dd-53c61ba02706 tempest-GroupsV314Test-624495855 None] Group tempest-GroupsV314Test-Group-687349279: creating Nov 05 11:03:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-9ab0ab1a-e324-4163-8d6f-73c66a85d472 req-f65d43ae-5b5b-4451-9a38-3e6adb92633a tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f42e499b-2727-4ade-a7dd-53c61ba02706 tempest-GroupsV314Test-624495855 None] Group tempest-GroupsV314Test-Group-687349279: created successfully Nov 05 11:03:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f42e499b-2727-4ade-a7dd-53c61ba02706 tempest-GroupsV314Test-624495855 None] Create group completed successfully. Nov 05 11:03:33 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550" returned: 0 in 0.506s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:33 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info Nov 05 11:03:33 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:34 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:34 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info is being set with open permissions: ugo+rw Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:34 devstack sudo[100051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info Nov 05 11:03:34 devstack sudo[100051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:34 devstack sudo[100051]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.info" returned: 0 in 0.451s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.982s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-9ab0ab1a-e324-4163-8d6f-73c66a85d472 req-f65d43ae-5b5b-4451-9a38-3e6adb92633a tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.326s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-9ab0ab1a-e324-4163-8d6f-73c66a85d472 req-f65d43ae-5b5b-4451-9a38-3e6adb92633a tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b1cdb961-5405-4203-8314-84e0a59bf1b2 tempest-SnapshotMetadataTestJSON-853497649 None] Create snapshot completed successfully Nov 05 11:03:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-9ab0ab1a-e324-4163-8d6f-73c66a85d472 req-f65d43ae-5b5b-4451-9a38-3e6adb92633a tempest-TestMinimumBasicScenario-504918328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-cc3f8624-425e-4990-aec3-8546c4cff904', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68899e16-cd89-43a2-89d6-5dbcffddc675', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:03:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-9ab0ab1a-e324-4163-8d6f-73c66a85d472 req-f65d43ae-5b5b-4451-9a38-3e6adb92633a tempest-TestMinimumBasicScenario-504918328 None] attachment_update completed successfully. Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Flow 'volume_create_manager' (b82978b9-019b-4641-aa8f-0de1d03cb03b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e788e4c-0d62-40a2-9a27-b9478fad06ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e788e4c-0d62-40a2-9a27-b9478fad06ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-637416421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ffab7d5-40db-4b66-8cb2-3804b8cd951c,host='devstack@QuobyteHD#QuobyteHD',id=b40d0484-e913-4698-bfc6-c7880d26c102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c378261a6542471bb4284c45bcdb5566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:36Z,use_quota=True,user_id='55f3172a7ad84067994b086679a5c869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3578decf-c1ef-4ba6-91e3-f4bc67febbbd),volume_type_id=3578decf-c1ef-4ba6-91e3-f4bc67febbbd)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bb99eb-70db-4ee5-a03c-fcedc8c0365e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07bb99eb-70db-4ee5-a03c-fcedc8c0365e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e64d6e-28e2-4a5e-a82f-7509ce47c9e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (24e64d6e-28e2-4a5e-a82f-7509ce47c9e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40d0484-e913-4698-bfc6-c7880d26c102', 'volume_name': 'volume-b40d0484-e913-4698-bfc6-c7880d26c102', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f2ca30-cdda-4028-b757-d34b39e58d6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f2ca30-cdda-4028-b757-d34b39e58d6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f1a57-fec5-4c91-b07d-f585c8ca0840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Volume b40d0484-e913-4698-bfc6-c7880d26c102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40d0484-e913-4698-bfc6-c7880d26c102', 'volume_size': 1} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8ffab7d5-40db-4b66-8cb2-3804b8cd951c,created_at=2026-11-05T10:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-637416421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8ffab7d5-40db-4b66-8cb2-3804b8cd951c,host='devstack@QuobyteHD#QuobyteHD',id=b40d0484-e913-4698-bfc6-c7880d26c102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c378261a6542471bb4284c45bcdb5566',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:36Z,use_quota=True,user_id='55f3172a7ad84067994b086679a5c869',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3578decf-c1ef-4ba6-91e3-f4bc67febbbd),volume_type_id=3578decf-c1ef-4ba6-91e3-f4bc67febbbd)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Creating volume b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:03:35 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:03:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:36 devstack sudo[100057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 1073741824 Nov 05 11:03:36 devstack sudo[100057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:36 devstack sudo[100057]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 1073741824" returned: 0 in 0.790s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:36 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:03:36 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:37 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.527s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] <== create_volume: return (1402ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.408s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f0f1a57-fec5-4c91-b07d-f585c8ca0840) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40d0484-e913-4698-bfc6-c7880d26c102', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c307ba8-727d-4b50-8024-bfec1799209e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:37 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Volume volume-b40d0484-e913-4698-bfc6-c7880d26c102 (b40d0484-e913-4698-bfc6-c7880d26c102): created successfully Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c307ba8-727d-4b50-8024-bfec1799209e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Flow 'volume_create_manager' (b82978b9-019b-4641-aa8f-0de1d03cb03b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fda3024a-66a1-48cc-92ea-b283816f72f4 tempest-GroupsV314Test-624495855 None] Created volume successfully. Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "cinder-1cb85ae7-f2cd-484d-92cf-2abf3ad75550-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-1cb85ae7-f2cd-484d-92cf-2abf3ad75550-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "cinder-quobyte-1cb85ae7-f2cd-484d-92cf-2abf3ad75550" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-1cb85ae7-f2cd-484d-92cf-2abf3ad75550" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Deleting offline snapshot 1cb85ae7-f2cd-484d-92cf-2abf3ad75550 of volume d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] snapshot_file for this snap is: volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c81278-7834-4b20-bec3-12a5aea44dfb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:37 devstack sudo[100067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 Nov 05 11:03:37 devstack sudo[100067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:38 devstack sudo[100067]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550" returned: 0 in 0.573s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d927dc84-a77a-488c-b732-dbf0f83df0c8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:03:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6d8086-6474-4945-9b86-228add2fa44a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:38 devstack sudo[100072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 Nov 05 11:03:38 devstack sudo[100072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:39 devstack sudo[100072]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8" returned: 0 in 0.886s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:39 devstack sudo[100079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 Nov 05 11:03:39 devstack sudo[100079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:39 devstack sudo[100079]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550" returned: 0 in 0.575s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:39 devstack sudo[100085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550 Nov 05 11:03:39 devstack sudo[100085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:39 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Cloning volume b40d0484-e913-4698-bfc6-c7880d26c102 to volume 9498df84-ab6d-44a8-9721-cb4a1e125945 Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Creating offline snapshot 5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 of volume b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[366a8200-9c0e-43c3-a83f-e85e8de2f1c2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:40 devstack sudo[100087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:03:40 devstack sudo[100087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:40 devstack sudo[100085]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8.1cb85ae7-f2cd-484d-92cf-2abf3ad75550" returned: 0 in 0.476s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-1cb85ae7-f2cd-484d-92cf-2abf3ad75550" released by "_delete_snapshot" :: held 2.697s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" released by "delete_snapshot" :: held 2.746s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Created reservations ['419d7e8d-dd08-4852-906f-ad53aa050f1b', '351d23e4-d435-4acb-9a9d-d4b6748d69f1', 'd6e8b893-0f10-4769-9264-38360ce815c5', '3335f165-3066-4e2f-9b1b-62115eae79a8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:03:40 devstack sudo[100087]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.575s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Delete snapshot completed successfully. Nov 05 11:03:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e0ec1112-c8b6-45b0-98ae-f1772bb3bed1 tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-1cb85ae7-f2cd-484d-92cf-2abf3ad75550-delete_snapshot" released by "delete_snapshot" :: held 3.016s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:40 devstack sudo[100093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 1G Nov 05 11:03:40 devstack sudo[100093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "cinder-d927dc84-a77a-488c-b732-dbf0f83df0c8-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-d927dc84-a77a-488c-b732-dbf0f83df0c8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d3b9fd-0c39-4596-a895-0700448014af]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:41 devstack sudo[100093]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 1G" returned: 0 in 0.810s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40d0484-e913-4698-bfc6-c7880d26c102 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:41 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40d0484-e913-4698-bfc6-c7880d26c102 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:41 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:41 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 Nov 05 11:03:41 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:42 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8" returned: 0 in 0.764s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:42 devstack sudo[100111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8 Nov 05 11:03:42 devstack sudo[100111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:42 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b40d0484-e913-4698-bfc6-c7880d26c102 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.785s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:42 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:42 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:42 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:42 devstack sudo[100111]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d927dc84-a77a-488c-b732-dbf0f83df0c8" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-quobyte-d927dc84-a77a-488c-b732-dbf0f83df0c8" released by "delete_volume" :: held 1.365s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Created reservations ['4c183f32-2cc8-438a-8b5c-b2648865b328', '560adde4-2551-4e5f-a8a6-c88165351ed3', '0a1b1896-1e9c-4a9b-9701-67738ac528e5', 'acd56d20-74f4-46f8-af69-c2d0cf561fd3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:03:42 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.479s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:42 devstack sudo[100117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:42 devstack sudo[100117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:42 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:03:42 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:43 devstack sudo[100117]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info" returned: 0 in 0.740s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:43 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:43 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.715s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:03:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Deleted volume successfully. Nov 05 11:03:43 devstack sudo[100126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info Nov 05 11:03:43 devstack sudo[100126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c6231d55-1090-4bdc-9b4d-9cfefedb118e tempest-SnapshotMetadataTestJSON-853497649 None] Lock "cinder-d927dc84-a77a-488c-b732-dbf0f83df0c8-delete_volume" released by "delete_volume" :: held 2.601s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:43 devstack sudo[100126]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.info" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Acquiring lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] snapshot: 5b458b9a-1a2d-4ae1-afba-e7a57c3490f9, volume: 9498df84-ab6d-44a8-9721-cb4a1e125945, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5a51c8a-064d-44f3-9b4e-0675c1df0479]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:44 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:44 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:44 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.659s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40d0484-e913-4698-bfc6-c7880d26c102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1953cb6a-8cff-4268-894d-094d9f5218ef]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:44 devstack sudo[100134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:03:44 devstack sudo[100134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:45 devstack sudo[100134]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.870s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:03:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:03:45 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:03:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:45 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 Nov 05 11:03:45 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:50 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:03:50 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:50 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.738s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:03:51 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:03:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:03:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:03:52 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=26,cinder:INSERT=21,cinder:SELECT=48,cinder:DELETE=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Flow 'volume_create_manager' (bc52ba74-4a65-4cc6-8989-d14911020fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879a9db-9e27-4347-aaf1-8db9360e21cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0879a9db-9e27-4347-aaf1-8db9360e21cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1261273891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051b993f-4849-49a0-bf63-e32be0739ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28793410e24473c9920be8c60e99895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:54Z,use_quota=True,user_id='b997c45431b14e6286c1d0602a3e8f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d0c40c-9faf-4411-b2e1-f96dfab73462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78d0c40c-9faf-4411-b2e1-f96dfab73462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94379e8-eaab-4c9d-acdb-cb837555030d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94379e8-eaab-4c9d-acdb-cb837555030d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '051b993f-4849-49a0-bf63-e32be0739ebc', 'volume_name': 'volume-051b993f-4849-49a0-bf63-e32be0739ebc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8a4e24-aaa5-4c75-9ed4-7c862c8fe159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef8a4e24-aaa5-4c75-9ed4-7c862c8fe159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe189f-d3f5-42a5-9685-1e99400049e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Volume 051b993f-4849-49a0-bf63-e32be0739ebc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-051b993f-4849-49a0-bf63-e32be0739ebc', 'volume_size': 1} Nov 05 11:03:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:55 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945" returned: 0 in 9.456s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102, size 1024.00 MB, duration 9.46 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:03:55 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Converted 1024.00 MB image at 108.28 MB/s Nov 05 11:03:55 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 is being set with open permissions: ugo+rw: NotImplementedError Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:55 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 Nov 05 11:03:55 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:55 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945" returned: 0 in 0.237s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" released by "_copy_volume_from_snapshot" :: held 11.360s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Acquiring lock "cinder-quobyte-5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Deleting offline snapshot 5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 of volume b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] snapshot_file for this snap is: volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7b5cc4c-5d99-480b-a2ae-4d30400ddf22]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:55 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:55 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:55 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.365s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b40d0484-e913-4698-bfc6-c7880d26c102(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[82959961-159c-4cb3-bb8c-64feaaf8b844]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:55 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:03:55 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:56 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:56 devstack sudo[100207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:56 devstack sudo[100207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:56 devstack sudo[100207]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.317s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:56 devstack sudo[100212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9 Nov 05 11:03:56 devstack sudo[100212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:56 devstack sudo[100212]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102.5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" returned: 0 in 0.248s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-5b458b9a-1a2d-4ae1-afba-e7a57c3490f9" released by "_delete_snapshot" :: held 1.522s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.028s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.245s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:03:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1261273891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=051b993f-4849-49a0-bf63-e32be0739ebc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a28793410e24473c9920be8c60e99895',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:03:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:03:54Z,use_quota=True,user_id='b997c45431b14e6286c1d0602a3e8f8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Creating volume 051b993f-4849-49a0-bf63-e32be0739ebc {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:03:56 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:03:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:56 devstack sudo[100215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc 1073741824 Nov 05 11:03:56 devstack sudo[100215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5e85cd4f-5a7c-4b47-b28c-028a1436f267 tempest-GroupsV314Test-624495855 None] Create group from source-group-8ffab7d5-40db-4b66-8cb2-3804b8cd951c completed successfully. Nov 05 11:03:57 devstack sudo[100215]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc 1073741824" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:57 devstack sudo[100221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc Nov 05 11:03:57 devstack sudo[100221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:57 devstack sudo[100221]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ebe189f-d3f5-42a5-9685-1e99400049e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-051b993f-4849-49a0-bf63-e32be0739ebc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c90014e-fa81-4536-be6e-67fac477a232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:03:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Volume volume-051b993f-4849-49a0-bf63-e32be0739ebc (051b993f-4849-49a0-bf63-e32be0739ebc): created successfully Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c90014e-fa81-4536-be6e-67fac477a232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:03:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Flow 'volume_create_manager' (bc52ba74-4a65-4cc6-8989-d14911020fd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:03:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9333283c-b943-4cdd-82ea-ccca1612b177 tempest-VolumesMetadataTest-1519444745 None] Created volume successfully. Nov 05 11:03:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Acquiring lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bea34835-665a-46d2-b2f6-008bd44d0979]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:58 devstack sudo[100225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 Nov 05 11:03:58 devstack sudo[100225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:59 devstack sudo[100225]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945" returned: 0 in 0.447s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:59 devstack sudo[100230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945 Nov 05 11:03:59 devstack sudo[100230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:59 devstack sudo[100230]: pam_unix(sudo:session): session closed for user root Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9498df84-ab6d-44a8-9721-cb4a1e125945" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-9498df84-ab6d-44a8-9721-cb4a1e125945" released by "delete_volume" :: held 0.849s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Created reservations ['85e65136-542c-4b98-94f7-8dbe78cc4270'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:03:59 devstack cinder-volume[87369]: WARNING cinder.quota [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-803262881 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-803262881, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:03:59 devstack cinder-volume[87369]: WARNING cinder.quota [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-803262881 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-803262881, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Created reservations ['721eb4f5-5ba8-4456-b95a-5c22c7d88b05', '534358f5-3221-4809-a37d-d9515a510bb3', 'ffb61986-18ec-4565-8309-3b2571adcb5a', '613ab365-5179-42cc-8de9-e310f15869f4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=60,cinder:INSERT=10,cinder:UPDATE=48,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Acquiring lock "cinder-051b993f-4849-49a0-bf63-e32be0739ebc-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "cinder-051b993f-4849-49a0-bf63-e32be0739ebc-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Acquiring lock "cinder-quobyte-051b993f-4849-49a0-bf63-e32be0739ebc" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:03:59 devstack sudo[100233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:03:59 devstack sudo[100233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "cinder-quobyte-051b993f-4849-49a0-bf63-e32be0739ebc" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c44a77a4-46bf-4f39-ac17-b1cdf13ebb54]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:03:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:00 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc Nov 05 11:04:00 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:00 devstack sudo[100233]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5cd9c0e5-cfdc-4405-a800-8916530556ee tempest-GroupsV314Test-624495855 None] Delete group completed successfully. Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Acquiring lock "cinder-quobyte-b40d0484-e913-4698-bfc6-c7880d26c102" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-b40d0484-e913-4698-bfc6-c7880d26c102" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e33e5099-85bb-4698-b4b4-1442213a41ca]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:00 devstack sudo[100238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:04:00 devstack sudo[100238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:00 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc" returned: 0 in 0.562s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:00 devstack sudo[100243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc Nov 05 11:04:00 devstack sudo[100243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:00 devstack sudo[100238]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.492s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:00 devstack sudo[100249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102 Nov 05 11:04:00 devstack sudo[100249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:00 devstack sudo[100243]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-051b993f-4849-49a0-bf63-e32be0739ebc" returned: 0 in 0.396s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "cinder-quobyte-051b993f-4849-49a0-bf63-e32be0739ebc" released by "delete_volume" :: held 1.045s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Created reservations ['089754c1-e150-4bbe-ba5d-5bdc0f50a29d', '9c2bd33a-4395-41f1-b41c-7afabcda16b3', '6032c9fa-b698-4562-bbb0-565cbd936e48', '1eef0d91-ba68-4922-b61e-2551fd3c2933'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:01 devstack sudo[100249]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b40d0484-e913-4698-bfc6-c7880d26c102" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:01 devstack sudo[100264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:01 devstack sudo[100264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Lock "cinder-quobyte-b40d0484-e913-4698-bfc6-c7880d26c102" released by "delete_volume" :: held 1.005s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Created reservations ['11c476c2-f975-4f51-8297-76cdea5829a0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Created reservations ['c9291e65-56a4-417b-b842-e1ca86a50a96', 'a89556be-8d0e-4b84-ad11-04521494ae2c', '643d5a47-6904-4fd5-83bb-e6094a66a8ef', '1274bb3b-b6d2-47ac-bf03-d20c8e524fa4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:01 devstack sudo[100264]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.478s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Deleted volume successfully. Nov 05 11:04:01 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:01 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7e5d4dc9-fd27-4a6b-a746-09e1a2af56b4 tempest-VolumesMetadataTest-1519444745 None] Lock "cinder-051b993f-4849-49a0-bf63-e32be0739ebc-delete_volume" released by "delete_volume" :: held 1.950s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:02 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.322s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:02 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-910481cc-7d6e-479e-ae8f-1ac09dc951da tempest-GroupsV314Test-624495855 None] Delete group completed successfully. Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Flow 'volume_create_manager' (242493b9-14c1-4ba4-9d40-441c0f805326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4de0eb-a827-4561-a111-a1fcc19df66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4de0eb-a827-4561-a111-a1fcc19df66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-224449830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703523a2-118a-4860-b947-4a416eb52094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f832decca3d47178692d68fd5df6f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:09Z,use_quota=True,user_id='c23120960cb74e6da2d885cd0401b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5f6cd-d8cc-45fc-aaa7-0933c88d67b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79b5f6cd-d8cc-45fc-aaa7-0933c88d67b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00535b86-6476-4f69-98ed-43cd6f98a89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00535b86-6476-4f69-98ed-43cd6f98a89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703523a2-118a-4860-b947-4a416eb52094', 'volume_name': 'volume-703523a2-118a-4860-b947-4a416eb52094', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737f734b-34c0-490e-91a5-a49bb2d82325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (737f734b-34c0-490e-91a5-a49bb2d82325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e3578-013b-4168-84b9-24f7bc740229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:09 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Volume 703523a2-118a-4860-b947-4a416eb52094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703523a2-118a-4860-b947-4a416eb52094', 'volume_size': 1} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-224449830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703523a2-118a-4860-b947-4a416eb52094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f832decca3d47178692d68fd5df6f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:09Z,use_quota=True,user_id='c23120960cb74e6da2d885cd0401b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Creating volume 703523a2-118a-4860-b947-4a416eb52094 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:09 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:09 devstack sudo[100303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 1073741824 Nov 05 11:04:09 devstack sudo[100303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:10 devstack sudo[100303]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 1073741824" returned: 0 in 0.617s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:10 devstack sudo[100309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 Nov 05 11:04:10 devstack sudo[100309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:10 devstack sudo[100309]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ca1e3578-013b-4168-84b9-24f7bc740229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703523a2-118a-4860-b947-4a416eb52094', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b6232-91c7-4f70-82de-3fa06c721b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:10 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Volume volume-703523a2-118a-4860-b947-4a416eb52094 (703523a2-118a-4860-b947-4a416eb52094): created successfully Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f9b6232-91c7-4f70-82de-3fa06c721b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Flow 'volume_create_manager' (242493b9-14c1-4ba4-9d40-441c0f805326) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d7cb8164-04af-492c-b131-71f07e54962a tempest-VolumesTransfersV355Test-997911025 None] Created volume successfully. Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Flow 'volume_create_manager' (6eeac940-71ba-4e7f-960d-6ba35c1b9c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab3a67f-6885-43b2-9d2e-fa85e712adb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab3a67f-6885-43b2-9d2e-fa85e712adb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-813448196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba1d2f6-c9a7-40f3-a722-613da2a93c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f759e12b20654beeb3017951dd609273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:11Z,use_quota=True,user_id='a31a4d9b0ab549a2abf9f0534b657a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8406e40f-1e75-423c-a630-37692f8a4b4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8406e40f-1e75-423c-a630-37692f8a4b4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212cc366-cbcb-489e-ba5b-ba22884c20c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (212cc366-cbcb-489e-ba5b-ba22884c20c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba1d2f6-c9a7-40f3-a722-613da2a93c3a', 'volume_name': 'volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca30b7e-6552-4304-8f98-244359d686f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ca30b7e-6552-4304-8f98-244359d686f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1f593e-c239-4df1-8240-3aeb904af6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:11 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Volume bba1d2f6-c9a7-40f3-a722-613da2a93c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a', 'volume_size': 1} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-813448196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba1d2f6-c9a7-40f3-a722-613da2a93c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f759e12b20654beeb3017951dd609273',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:11Z,use_quota=True,user_id='a31a4d9b0ab549a2abf9f0534b657a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Creating volume bba1d2f6-c9a7-40f3-a722-613da2a93c3a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:11 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:11 devstack sudo[100312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a 1073741824 Nov 05 11:04:11 devstack sudo[100312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:11 devstack sudo[100312]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a 1073741824" returned: 0 in 0.501s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:11 devstack sudo[100318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a Nov 05 11:04:11 devstack sudo[100318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:11 devstack sudo[100318]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1f593e-c239-4df1-8240-3aeb904af6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ef7d7-07f6-4924-a73d-be43b694e6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:12 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Volume volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a (bba1d2f6-c9a7-40f3-a722-613da2a93c3a): created successfully Nov 05 11:04:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (713ef7d7-07f6-4924-a73d-be43b694e6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:12 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Flow 'volume_create_manager' (6eeac940-71ba-4e7f-960d-6ba35c1b9c28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-99e85a7f-479e-492c-ac9e-d94a4fc16bd6 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Created volume successfully. Nov 05 11:04:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2f968c78-2bad-4808-bd0e-7a93d431e8bd tempest-VolumesTransfersV355Test-937907557 None] Transfer volume completed successfully. Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "cinder-703523a2-118a-4860-b947-4a416eb52094-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-703523a2-118a-4860-b947-4a416eb52094-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "cinder-quobyte-703523a2-118a-4860-b947-4a416eb52094" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-quobyte-703523a2-118a-4860-b947-4a416eb52094" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb7d3af-0da2-4968-a437-fd2ea70f2f35]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:13 devstack sudo[100321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 Nov 05 11:04:13 devstack sudo[100321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:13 devstack sudo[100321]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094" returned: 0 in 0.441s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:13 devstack sudo[100326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094 Nov 05 11:04:13 devstack sudo[100326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:14 devstack sudo[100326]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-703523a2-118a-4860-b947-4a416eb52094" returned: 0 in 0.297s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-quobyte-703523a2-118a-4860-b947-4a416eb52094" released by "delete_volume" :: held 0.800s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Created reservations ['85b904ee-657d-4542-a4ad-4bc497f63900', '5ecb0e48-2cb2-408a-831a-cc909c138355', '60b0b1e2-b500-4463-a420-924d82a5ab17', '815b7685-2272-4e0e-859c-98fa6aa3ba98'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:14 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:14 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:14 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.347s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Deleted volume successfully. Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Acquiring lock "cinder-bba1d2f6-c9a7-40f3-a722-613da2a93c3a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e22f9f5-a87d-410f-b9be-a1043a176e16 tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-703523a2-118a-4860-b947-4a416eb52094-delete_volume" released by "delete_volume" :: held 1.461s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "cinder-bba1d2f6-c9a7-40f3-a722-613da2a93c3a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Acquiring lock "cinder-quobyte-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "cinder-quobyte-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" acquired by "delete_volume" :: waited 0.013s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dce45c5a-1332-4041-a171-ffa0649702d0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:14 devstack sudo[100332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a Nov 05 11:04:14 devstack sudo[100332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Flow 'volume_create_manager' (b89cb729-984c-4ce5-b746-4a7e50a37b90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14130981-619a-4b36-8649-88bdf08d54e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14130981-619a-4b36-8649-88bdf08d54e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405706195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95094c75-5f58-437e-ade2-33f11dd91044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f832decca3d47178692d68fd5df6f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:15Z,use_quota=True,user_id='c23120960cb74e6da2d885cd0401b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf898ed-9e96-44b0-8f79-021cbca521a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bf898ed-9e96-44b0-8f79-021cbca521a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db38c312-b822-4df2-a67a-11cecbc92ae4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:15 devstack sudo[100332]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db38c312-b822-4df2-a67a-11cecbc92ae4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '95094c75-5f58-437e-ade2-33f11dd91044', 'volume_name': 'volume-95094c75-5f58-437e-ade2-33f11dd91044', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e690d3-e5ed-4760-83ba-29c85516e8ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3e690d3-e5ed-4760-83ba-29c85516e8ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ef2abd-29de-4866-859e-d41f17339147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:15 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Volume 95094c75-5f58-437e-ade2-33f11dd91044: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-95094c75-5f58-437e-ade2-33f11dd91044', 'volume_size': 1} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-405706195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=95094c75-5f58-437e-ade2-33f11dd91044,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7f832decca3d47178692d68fd5df6f7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:15Z,use_quota=True,user_id='c23120960cb74e6da2d885cd0401b368',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Creating volume 95094c75-5f58-437e-ade2-33f11dd91044 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:15 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" returned: 0 in 0.530s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:15 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 1073741824 Nov 05 11:04:15 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:15 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a Nov 05 11:04:15 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:15 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "cinder-quobyte-bba1d2f6-c9a7-40f3-a722-613da2a93c3a" released by "delete_volume" :: held 0.935s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Created reservations ['64157ee1-38ba-4f90-8dbb-7ed5aa927d21', '9caec087-a54a-4e86-8d81-89427638ff44', 'e12ab9cd-0e54-459d-8311-ca81e7788e70', 'c0f68d8a-00fe-4c64-9866-f67c5a103110'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:15 devstack sudo[100350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:15 devstack sudo[100350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:15 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 1073741824" returned: 0 in 0.700s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:16 devstack sudo[100354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 Nov 05 11:04:16 devstack sudo[100354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:16 devstack sudo[100350]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.397s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Deleted volume successfully. Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0a8bb1c9-65a8-4d4a-b145-49799742d8f8 tempest-VolumeQuotasNegativeTestJSON-283930571 None] Lock "cinder-bba1d2f6-c9a7-40f3-a722-613da2a93c3a-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:16 devstack sudo[100354]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] <== create_volume: return (1265ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.268s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25ef2abd-29de-4866-859e-d41f17339147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-95094c75-5f58-437e-ade2-33f11dd91044', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b773986a-c8f4-45dc-bf40-bc68445ddcc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:16 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Volume volume-95094c75-5f58-437e-ade2-33f11dd91044 (95094c75-5f58-437e-ade2-33f11dd91044): created successfully Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b773986a-c8f4-45dc-bf40-bc68445ddcc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Flow 'volume_create_manager' (b89cb729-984c-4ce5-b746-4a7e50a37b90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-02559d46-e56b-402d-82fa-fc249dcf3d34 tempest-VolumesTransfersV355Test-997911025 None] Created volume successfully. Nov 05 11:04:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "cinder-95094c75-5f58-437e-ade2-33f11dd91044-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-95094c75-5f58-437e-ade2-33f11dd91044-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "cinder-quobyte-95094c75-5f58-437e-ade2-33f11dd91044" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-quobyte-95094c75-5f58-437e-ade2-33f11dd91044" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad52cba-e554-47b7-9f35-c970a11d47ff]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:18 devstack sudo[100377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 Nov 05 11:04:18 devstack sudo[100377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:18 devstack sudo[100377]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:18 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044 Nov 05 11:04:18 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:18 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-95094c75-5f58-437e-ade2-33f11dd91044" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-quobyte-95094c75-5f58-437e-ade2-33f11dd91044" released by "delete_volume" :: held 0.918s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Created reservations ['a016e5ff-eebe-492f-a68c-7dc84f512cf2', '8bc5a36e-f376-4272-9807-812440347b78', '0854cab0-b72c-4f5c-804c-c85143757cf7', '63fb1b50-4901-463d-907f-688033390e34'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:19 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:19 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-131a0ca9-b097-43c7-84f2-82af6933806b req-c662b013-eb9b-42c8-a0bc-ded5e36e4d73 tempest-TestShelveInstance-1178818745 None] Terminate volume connection completed successfully. Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-131a0ca9-b097-43c7-84f2-82af6933806b req-c662b013-eb9b-42c8-a0bc-ded5e36e4d73 tempest-TestShelveInstance-1178818745 None] Deleting attachment f13577d2-09d1-4ae5-ade2-2954c32fd6e3. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:04:19 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.425s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Deleted volume successfully. Nov 05 11:04:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52836910-7b83-43ab-a95a-a8204a3c297e tempest-VolumesTransfersV355Test-567904906 None] Lock "cinder-95094c75-5f58-437e-ade2-33f11dd91044-delete_volume" released by "delete_volume" :: held 1.791s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ff7d1565-5a39-4cf7-9a10-2285432970e5 req-fac51884-e7c3-4b44-80fa-c658c8328b3a tempest-TestShelveInstance-1178818745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ff7d1565-5a39-4cf7-9a10-2285432970e5 req-fac51884-e7c3-4b44-80fa-c658c8328b3a tempest-TestShelveInstance-1178818745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ff7d1565-5a39-4cf7-9a10-2285432970e5 req-fac51884-e7c3-4b44-80fa-c658c8328b3a tempest-TestShelveInstance-1178818745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ff7d1565-5a39-4cf7-9a10-2285432970e5 req-fac51884-e7c3-4b44-80fa-c658c8328b3a tempest-TestShelveInstance-1178818745 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-85cebfd7-a161-490f-96be-1359d069d0e1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'cb633b28-c73b-43da-8388-d9d4fbbba7b6', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:04:23 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-ff7d1565-5a39-4cf7-9a10-2285432970e5 req-fac51884-e7c3-4b44-80fa-c658c8328b3a tempest-TestShelveInstance-1178818745 None] attachment_update completed successfully. Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Flow 'volume_create_manager' (d5060365-ec56-46f0-9c60-78ff2000a768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c036c03-0b4c-40a2-9ddf-6266f24ad1e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c036c03-0b4c-40a2-9ddf-6266f24ad1e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-275059127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1284b109-41c3-4a46-85e9-47a4b6c279fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178e1ef52c2a470cb4072e689312d1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:29Z,use_quota=True,user_id='233963c2dcc845bb862e15bdff95430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64193d4-3b94-462c-8432-eea84d5e4ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64193d4-3b94-462c-8432-eea84d5e4ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959f2ac2-ece9-4d3d-a273-4a651a0273c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (959f2ac2-ece9-4d3d-a273-4a651a0273c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1284b109-41c3-4a46-85e9-47a4b6c279fc', 'volume_name': 'volume-1284b109-41c3-4a46-85e9-47a4b6c279fc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4742e0b-ea31-41fe-856d-f1a83490e674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4742e0b-ea31-41fe-856d-f1a83490e674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fc093-ef86-4ab8-a674-a7e1eae49e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:28 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Volume 1284b109-41c3-4a46-85e9-47a4b6c279fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1284b109-41c3-4a46-85e9-47a4b6c279fc', 'volume_size': 1} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-275059127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1284b109-41c3-4a46-85e9-47a4b6c279fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='178e1ef52c2a470cb4072e689312d1ac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:29Z,use_quota=True,user_id='233963c2dcc845bb862e15bdff95430a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Creating volume 1284b109-41c3-4a46-85e9-47a4b6c279fc {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:28 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:28 devstack sudo[100469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc 1073741824 Nov 05 11:04:28 devstack sudo[100469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:29 devstack sudo[100469]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc 1073741824" returned: 0 in 0.980s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:30 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc Nov 05 11:04:30 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:30 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc" returned: 0 in 0.445s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (817fc093-ef86-4ab8-a674-a7e1eae49e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1284b109-41c3-4a46-85e9-47a4b6c279fc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06c185-1fd6-4162-a0f0-2f4ce0296160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Volume volume-1284b109-41c3-4a46-85e9-47a4b6c279fc (1284b109-41c3-4a46-85e9-47a4b6c279fc): created successfully Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa06c185-1fd6-4162-a0f0-2f4ce0296160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Flow 'volume_create_manager' (d5060365-ec56-46f0-9c60-78ff2000a768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:30 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-edb3d632-0abc-405a-8a96-bbbb88597deb tempest-VolumesServicesTestJSON-1852563272 None] Created volume successfully. Nov 05 11:04:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Acquiring lock "cinder-1284b109-41c3-4a46-85e9-47a4b6c279fc-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "cinder-1284b109-41c3-4a46-85e9-47a4b6c279fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Acquiring lock "cinder-quobyte-1284b109-41c3-4a46-85e9-47a4b6c279fc" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "cinder-quobyte-1284b109-41c3-4a46-85e9-47a4b6c279fc" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cebb35cf-90b5-4e83-a5f3-9486940f9c62]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:31 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc Nov 05 11:04:31 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:31 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc" returned: 0 in 0.595s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:31 devstack sudo[100550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc Nov 05 11:04:31 devstack sudo[100550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:32 devstack sudo[100550]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1284b109-41c3-4a46-85e9-47a4b6c279fc" returned: 0 in 0.288s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "cinder-quobyte-1284b109-41c3-4a46-85e9-47a4b6c279fc" released by "delete_volume" :: held 0.937s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Created reservations ['355e1579-970b-4b82-8eb9-18adf2c7bbc8', 'cb7b92f3-6f92-416b-bb9e-084b6c4b8474', '4620e2e5-67d1-4f3c-afff-b025710b39c7', '7dafc5fc-2b08-41ce-af2c-3764693fab99'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:32 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:32 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:32 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Deleted volume successfully. Nov 05 11:04:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be77d931-4283-4ca5-b518-76bc106e1345 tempest-VolumesServicesTestJSON-1852563272 None] Lock "cinder-1284b109-41c3-4a46-85e9-47a4b6c279fc-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Flow 'volume_create_manager' (5af170c8-c3fb-42dc-97e9-eb7241ef1f79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5333f163-1ca0-4dc1-97f2-8e7ece50b04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5333f163-1ca0-4dc1-97f2-8e7ece50b04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-618479521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d145d2e61949e880b39072698f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:35Z,use_quota=True,user_id='9a736ee127564a82b15127e9f571ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616109e0-11e5-4caa-9ebd-dd9058352a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616109e0-11e5-4caa-9ebd-dd9058352a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4604693-e50b-4e66-9bd4-73b645479cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4604693-e50b-4e66-9bd4-73b645479cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7', 'volume_name': 'volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497272b0-d7df-416e-b916-990d9cf4dc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (497272b0-d7df-416e-b916-990d9cf4dc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e931797-01e5-449f-801b-df66663e2ce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Volume adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7', 'volume_size': 1} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-618479521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d145d2e61949e880b39072698f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:35Z,use_quota=True,user_id='9a736ee127564a82b15127e9f571ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Creating volume adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:35 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:35 devstack sudo[100556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 1073741824 Nov 05 11:04:35 devstack sudo[100556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:35 devstack sudo[100556]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 1073741824" returned: 0 in 0.614s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:35 devstack sudo[100563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 Nov 05 11:04:35 devstack sudo[100563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:36 devstack sudo[100563]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" returned: 0 in 0.392s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] <== create_volume: return (1065ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e931797-01e5-449f-801b-df66663e2ce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0f6108-788b-41a3-874e-411c44e938b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:36 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Volume volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 (adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7): created successfully Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c0f6108-788b-41a3-874e-411c44e938b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Flow 'volume_create_manager' (5af170c8-c3fb-42dc-97e9-eb7241ef1f79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8f3eb8f1-2c20-4c60-9d45-089d4db37482 tempest-VolumesTransfersV357Test-185499278 None] Created volume successfully. Nov 05 11:04:38 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f9706c6a-7341-4067-9ef0-a0a4e89e4219 tempest-VolumesTransfersV357Test-1938026925 None] Transfer volume completed successfully. Nov 05 11:04:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "cinder-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "cinder-quobyte-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-quobyte-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d5ead44-2176-495f-9fa3-096a9fa58ed2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:39 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 Nov 05 11:04:39 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:39 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" returned: 0 in 0.469s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:39 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7 Nov 05 11:04:39 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:39 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" returned: 0 in 0.418s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-quobyte-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7" released by "delete_volume" :: held 0.955s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Created reservations ['4af1e438-ac24-4100-aeab-57e28cbd5e4d', '52a97a05-d2b5-423c-b5a7-bae7e82d0031', 'aba0b579-3cd4-4b1e-a057-91d724f20ac1', '66cefff4-e9d0-4916-a9ea-1a1b73151f91'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:40 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:40 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:40 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.383s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Deleted volume successfully. Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5edf9a05-9b70-4361-b92d-304e9df061d1 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-adeeb8fc-cd8d-4ca4-b9b9-9200457c15f7-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Flow 'volume_create_manager' (93b2b9ea-d543-4569-9b30-f29c4a40ee8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b176a21-2646-4c68-8afa-eea29a2963df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b176a21-2646-4c68-8afa-eea29a2963df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2102497565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4f45c7-4021-4e32-8106-a1537b2b0748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c3a30477124342882a3e43d2764199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:41Z,use_quota=True,user_id='7c223e31d44c41f1865a3b4c889e7b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e85dc3-fcfd-4a39-b290-8f55fccdc7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e85dc3-fcfd-4a39-b290-8f55fccdc7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef58823-7214-40e2-9806-6047159928a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eef58823-7214-40e2-9806-6047159928a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb4f45c7-4021-4e32-8106-a1537b2b0748', 'volume_name': 'volume-cb4f45c7-4021-4e32-8106-a1537b2b0748', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79402672-0b6b-405b-b083-cd25e118aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79402672-0b6b-405b-b083-cd25e118aa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8add1e36-4a51-4f7c-a830-4d37da0ff339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Volume cb4f45c7-4021-4e32-8106-a1537b2b0748: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb4f45c7-4021-4e32-8106-a1537b2b0748', 'volume_size': 1} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2102497565',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb4f45c7-4021-4e32-8106-a1537b2b0748,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54c3a30477124342882a3e43d2764199',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:41Z,use_quota=True,user_id='7c223e31d44c41f1865a3b4c889e7b16',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Creating volume cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:40 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:40 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 1073741824 Nov 05 11:04:40 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:41 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 1073741824" returned: 0 in 0.657s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:41 devstack sudo[100590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 Nov 05 11:04:41 devstack sudo[100590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:42 devstack sudo[100590]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748" returned: 0 in 0.673s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] <== create_volume: return (1424ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8add1e36-4a51-4f7c-a830-4d37da0ff339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb4f45c7-4021-4e32-8106-a1537b2b0748', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d657bde0-e21d-4c3b-9714-5c522d7ad37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Flow 'volume_create_manager' (468fcbdd-087d-4634-a311-e76c55219ce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3881556a-596a-43d9-bda1-d5705bdf7e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Volume volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 (cb4f45c7-4021-4e32-8106-a1537b2b0748): created successfully Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d657bde0-e21d-4c3b-9714-5c522d7ad37c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Flow 'volume_create_manager' (93b2b9ea-d543-4569-9b30-f29c4a40ee8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3881556a-596a-43d9-bda1-d5705bdf7e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-194743538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fdd278-e4c0-421d-8a96-2bc1276bc77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d145d2e61949e880b39072698f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:42Z,use_quota=True,user_id='9a736ee127564a82b15127e9f571ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db04342-1235-4e34-a146-ab9612fc9f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db04342-1235-4e34-a146-ab9612fc9f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3737fa9-5faa-45d2-8997-7c7b0fb62f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3737fa9-5faa-45d2-8997-7c7b0fb62f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '39fdd278-e4c0-421d-8a96-2bc1276bc77f', 'volume_name': 'volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45d96a-f6a0-4851-a000-5a58d12aff60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b45d96a-f6a0-4851-a000-5a58d12aff60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3831930a-3455-4436-83d9-e552cb017d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Volume 39fdd278-e4c0-421d-8a96-2bc1276bc77f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f', 'volume_size': 1} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-194743538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=39fdd278-e4c0-421d-8a96-2bc1276bc77f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04d145d2e61949e880b39072698f94c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:04:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:04:42Z,use_quota=True,user_id='9a736ee127564a82b15127e9f571ec82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Creating volume 39fdd278-e4c0-421d-8a96-2bc1276bc77f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:04:42 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:04:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2d101a6e-8719-454a-a0fa-6f190a36ab4a tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Created volume successfully. Nov 05 11:04:42 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f 1073741824 Nov 05 11:04:42 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:43 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f 1073741824" returned: 0 in 0.635s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:43 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f Nov 05 11:04:43 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:43 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f" returned: 0 in 0.476s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] <== create_volume: return (1228ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.231s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.232s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3831930a-3455-4436-83d9-e552cb017d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c81df83-cd56-4f33-b975-fb49a97d98e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Creating offline snapshot b1945bb0-2649-4654-b535-10fa0d624a65 of volume cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:04:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Volume volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f (39fdd278-e4c0-421d-8a96-2bc1276bc77f): created successfully Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c81df83-cd56-4f33-b975-fb49a97d98e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Flow 'volume_create_manager' (468fcbdd-087d-4634-a311-e76c55219ce7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e6e4d4-5385-46e1-b788-82fef1bbf701]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-67f442fe-7061-45e1-8593-b6927730958e tempest-VolumesTransfersV357Test-185499278 None] Created volume successfully. Nov 05 11:04:43 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 Nov 05 11:04:43 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:44 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748" returned: 0 in 0.591s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:44 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 1G Nov 05 11:04:44 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-f4475b9d-af4a-46b5-b32a-c16b0d9714d1 req-50dc8525-b89a-4979-bfd7-b9153e0cea80 tempest-TestMinimumBasicScenario-504918328 None] Terminate volume connection completed successfully. Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-f4475b9d-af4a-46b5-b32a-c16b0d9714d1 req-50dc8525-b89a-4979-bfd7-b9153e0cea80 tempest-TestMinimumBasicScenario-504918328 None] Deleting attachment 68899e16-cd89-43a2-89d6-5dbcffddc675. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "cinder-39fdd278-e4c0-421d-8a96-2bc1276bc77f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-39fdd278-e4c0-421d-8a96-2bc1276bc77f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "cinder-quobyte-39fdd278-e4c0-421d-8a96-2bc1276bc77f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:44 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 1G" returned: 0 in 0.626s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-quobyte-39fdd278-e4c0-421d-8a96-2bc1276bc77f" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:44 devstack sudo[100617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 Nov 05 11:04:44 devstack sudo[100617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1dc689d-3f6f-4edf-98d7-1d03c560d1e9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f Nov 05 11:04:45 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "cinder-cc3f8624-425e-4990-aec3-8546c4cff904-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "cinder-cc3f8624-425e-4990-aec3-8546c4cff904-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "cinder-quobyte-cc3f8624-425e-4990-aec3-8546c4cff904" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "cinder-quobyte-cc3f8624-425e-4990-aec3-8546c4cff904" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:45 devstack sudo[100617]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:45 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 is being set with open permissions: ugo+rw Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8ef37b-750e-49db-9a3e-c4a158a8169f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack sudo[100625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 Nov 05 11:04:45 devstack sudo[100625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack sudo[100626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 Nov 05 11:04:45 devstack sudo[100626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f" returned: 0 in 0.574s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack sudo[100632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f Nov 05 11:04:45 devstack sudo[100632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack sudo[100625]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info Nov 05 11:04:45 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack sudo[100626]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904" returned: 0 in 0.463s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:45 devstack sudo[100632]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-39fdd278-e4c0-421d-8a96-2bc1276bc77f" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:45 devstack sudo[100642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904 Nov 05 11:04:45 devstack sudo[100642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-quobyte-39fdd278-e4c0-421d-8a96-2bc1276bc77f" released by "delete_volume" :: held 0.933s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:45 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Created reservations ['8bae346b-05ce-4752-9d05-63d1bd8206ed', 'f8ca0171-7066-438b-96b5-21868003e6dc', 'dfdb4e8b-1078-4cf7-8a6f-bb30a03971ec', '97b48a69-019f-4230-8540-8489d6240dab'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:46 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:46 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:46 devstack sudo[100642]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc3f8624-425e-4990-aec3-8546c4cff904" returned: 0 in 0.332s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:46 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:46 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info is being set with open permissions: ugo+rw Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "cinder-quobyte-cc3f8624-425e-4990-aec3-8546c4cff904" released by "delete_volume" :: held 0.874s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:46 devstack sudo[100648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info Nov 05 11:04:46 devstack sudo[100648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Created reservations ['a4bcc266-d646-4be5-bbdf-3ca3b560115e', '9506fa48-3064-4d8a-a12e-a822dc99607a', '153ad86f-b9b4-4399-b616-d69f406760a8', 'f07c038a-bde9-4537-929c-bd15bebd5005'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:46 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Deleted volume successfully. Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4a5b1068-db63-403a-8172-9b29a8a1e317 tempest-VolumesTransfersV357Test-95341013 None] Lock "cinder-39fdd278-e4c0-421d-8a96-2bc1276bc77f-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:46 devstack sudo[100651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:46 devstack sudo[100651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:46 devstack sudo[100648]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.info" returned: 0 in 0.412s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.024s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b6096e92-6473-4850-b4d1-da479936c41c tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Create snapshot completed successfully Nov 05 11:04:46 devstack sudo[100651]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.387s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Deleted volume successfully. Nov 05 11:04:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d9e7ec62-d566-4eda-bdad-e058535d2b96 tempest-TestMinimumBasicScenario-504918328 None] Lock "cinder-cc3f8624-425e-4990-aec3-8546c4cff904-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "cinder-b1945bb0-2649-4654-b535-10fa0d624a65-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-b1945bb0-2649-4654-b535-10fa0d624a65-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "cinder-quobyte-b1945bb0-2649-4654-b535-10fa0d624a65" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-b1945bb0-2649-4654-b535-10fa0d624a65" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Deleting offline snapshot b1945bb0-2649-4654-b535-10fa0d624a65 of volume cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] snapshot_file for this snap is: volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe00e833-bae6-4131-8998-784aa8a89337]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:48 devstack sudo[100681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 Nov 05 11:04:48 devstack sudo[100681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:49 devstack sudo[100681]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cb4f45c7-4021-4e32-8106-a1537b2b0748(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ad374fb-f147-4426-bff5-f83548da46f4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:49 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 Nov 05 11:04:49 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:49 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748" returned: 0 in 0.540s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:49 devstack sudo[100691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 Nov 05 11:04:49 devstack sudo[100691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:50 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:50 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:50 devstack sudo[100691]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:50 devstack sudo[100699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65 Nov 05 11:04:50 devstack sudo[100699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:50 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.337s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:04:50 devstack sudo[100699]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748.b1945bb0-2649-4654-b535-10fa0d624a65" returned: 0 in 0.354s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-b1945bb0-2649-4654-b535-10fa0d624a65" released by "_delete_snapshot" :: held 1.965s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" released by "delete_snapshot" :: held 1.994s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Created reservations ['83907d70-5bb3-49b4-92db-e117fe9b04b8', '0da5bab9-e676-4a70-ba8f-410599e8b154', 'aaf0943b-be97-40f9-972d-af58edf5381b', '57491f1d-c832-41ca-bb19-185d970af849'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Delete snapshot completed successfully. Nov 05 11:04:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-52fa9e72-41d2-4927-925a-28665d49874f tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-b1945bb0-2649-4654-b535-10fa0d624a65-delete_snapshot" released by "delete_snapshot" :: held 2.190s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "cinder-cb4f45c7-4021-4e32-8106-a1537b2b0748-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-cb4f45c7-4021-4e32-8106-a1537b2b0748-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[84020b21-1cd5-4d2d-bb8a-aa860cfcb528]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:52 devstack sudo[100704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 Nov 05 11:04:52 devstack sudo[100704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:52 devstack sudo[100704]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748" returned: 0 in 0.495s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:52 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748 Nov 05 11:04:52 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:53 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cb4f45c7-4021-4e32-8106-a1537b2b0748" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-quobyte-cb4f45c7-4021-4e32-8106-a1537b2b0748" released by "delete_volume" :: held 0.894s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=126,cinder:SELECT=89,cinder:INSERT=31,cinder:DELETE=11 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Created reservations ['67358db9-4f57-469b-bc6d-b0d8c596fd30', 'd9e0da00-8398-4034-98f0-49c3480f58bb', 'e490dbe0-a1b0-4369-b254-cea337669c76', '78bd8604-2aea-478b-b769-e0d4452aef21'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:04:53 devstack sudo[100712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:04:53 devstack sudo[100712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:04:53 devstack sudo[100712]: pam_unix(sudo:session): session closed for user root Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.308s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:04:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Deleted volume successfully. Nov 05 11:04:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c9203746-d630-4c8a-823f-af98352d92b4 tempest-VolumeSnapshotQuotasNegativeTestJSON-725706579 None] Lock "cinder-cb4f45c7-4021-4e32-8106-a1537b2b0748-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:03 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:INSERT=3,cinder:UPDATE=6,cinder:SELECT=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:05:03 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=119,cinder:SELECT=97,cinder:INSERT=22,cinder:DELETE=6 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Flow 'volume_create_manager' (cb2cd08f-5ae3-4d02-8372-d0464e88d223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964a03ae-3b14-47ff-877d-31b400021baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (964a03ae-3b14-47ff-877d-31b400021baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793384193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e8b732-39e8-48cc-89bf-b2c45fe2b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e05c0fb5904070960e4a0a3dcdcf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:12Z,use_quota=True,user_id='79464903c0f34ed59f0bef8fed1db1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d34bab-5499-401b-915d-fc55899d8e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27d34bab-5499-401b-915d-fc55899d8e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612d539-7b8f-4a3e-b32b-161f5418d2ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3612d539-7b8f-4a3e-b32b-161f5418d2ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15e8b732-39e8-48cc-89bf-b2c45fe2b408', 'volume_name': 'volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd1adcb-90a4-4309-b1a8-f38a333cf8c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fd1adcb-90a4-4309-b1a8-f38a333cf8c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d647d9-bd7b-4375-b900-5f948c99d207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:11 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408', 'volume_size': 1} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-793384193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15e8b732-39e8-48cc-89bf-b2c45fe2b408,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7e05c0fb5904070960e4a0a3dcdcf7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:12Z,use_quota=True,user_id='79464903c0f34ed59f0bef8fed1db1c8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Creating volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:11 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:05:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:12 devstack sudo[100760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 1073741824 Nov 05 11:05:12 devstack sudo[100760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:12 devstack sudo[100760]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 1073741824" returned: 0 in 0.822s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:12 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:05:12 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-bc79cf09-a46d-4a3b-9b93-096dd58a4328 tempest-TestShelveInstance-1178818745 None] Terminate volume connection completed successfully. Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-bc79cf09-a46d-4a3b-9b93-096dd58a4328 tempest-TestShelveInstance-1178818745 None] Deleting attachment cb633b28-c73b-43da-8388-d9d4fbbba7b6. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Acquiring lock "cinder-85cebfd7-a161-490f-96be-1359d069d0e1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "cinder-85cebfd7-a161-490f-96be-1359d069d0e1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Acquiring lock "cinder-quobyte-85cebfd7-a161-490f-96be-1359d069d0e1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "cinder-quobyte-85cebfd7-a161-490f-96be-1359d069d0e1" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc6212b6-093a-4abb-9b48-5c4b773987ab]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:13 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.609s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] <== create_volume: return (1554ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1d647d9-bd7b-4375-b900-5f948c99d207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856eb80a-d876-43b6-a769-2588ba07789f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:13 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Volume volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 (15e8b732-39e8-48cc-89bf-b2c45fe2b408): created successfully Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (856eb80a-d876-43b6-a769-2588ba07789f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Flow 'volume_create_manager' (cb2cd08f-5ae3-4d02-8372-d0464e88d223) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2a4688f1-de6c-4925-9746-09d49c971f42 tempest-VolumesActionsTest-1655116761 None] Created volume successfully. Nov 05 11:05:13 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 Nov 05 11:05:13 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:14 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1" returned: 0 in 0.717s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:14 devstack sudo[100776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1 Nov 05 11:05:14 devstack sudo[100776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:14 devstack sudo[100776]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-85cebfd7-a161-490f-96be-1359d069d0e1" returned: 0 in 0.471s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "cinder-quobyte-85cebfd7-a161-490f-96be-1359d069d0e1" released by "delete_volume" :: held 1.285s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:14 devstack cinder-volume[87369]: DEBUG cinder.quota [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Created reservations ['78fc31d4-6d9a-49dc-ae67-e8e26bf1bc1a', 'f0c1b4bb-f656-4087-b173-de686721f1de', 'fcf1fbb4-fbe4-47e7-bb19-21b0c52cd3e5', '548da6ed-a811-4c4d-be21-220952b1bb08'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:15 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:05:15 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:15 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.581s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.manager [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:05:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Deleted volume successfully. Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Flow 'volume_create_manager' (8c1e6164-c67c-44f8-bdc9-0227bd821997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e1ec34-1ca9-4155-ac41-e15a601c05e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [req-204bbe22-b174-4ee6-941d-5e5ab021131e req-5b96b376-2009-4b22-826e-a414a224aed8 tempest-TestShelveInstance-1178818745 None] Lock "cinder-85cebfd7-a161-490f-96be-1359d069d0e1-delete_volume" released by "delete_volume" :: held 2.397s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43e1ec34-1ca9-4155-ac41-e15a601c05e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db199da6-ab76-4e1b-98f3-e81f0e02da97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2727aad0f0b14a17a82934f950a14e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:16Z,use_quota=True,user_id='c0f56ed1112a4f8e90921114ef638584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a3e85d0-3066-4ed5-a813-a09638f2d0b5),volume_type_id=9a3e85d0-3066-4ed5-a813-a09638f2d0b5)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bca8b7-a536-4c90-a1b8-8daf75283604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5bca8b7-a536-4c90-a1b8-8daf75283604) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160d5cd-f05b-41b1-923c-48c839b657ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:15 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:05:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8160d5cd-f05b-41b1-923c-48c839b657ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db199da6-ab76-4e1b-98f3-e81f0e02da97', 'volume_name': 'volume-db199da6-ab76-4e1b-98f3-e81f0e02da97', 'volume_size': 1, 'image_id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b23bef189a901542dc0887c3bbc7cec0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2727aad0f0b14a17a82934f950a14e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b7a9756ac4a5d100afca814ecdd50ca5936989d44391734d6fd420274edd7713e9ec3b575e0078714783a0794fc9aeff92100977690231814b0627dc5094f3c', 'id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'created_at': datetime.datetime(2026, 11, 5, 10, 5, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 5, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab387cf-69b0-4908-af97-8f8dfd907c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab387cf-69b0-4908-af97-8f8dfd907c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:16 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cc91e3-4c72-4619-9a03-51837f4b11d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:16 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Volume db199da6-ab76-4e1b-98f3-e81f0e02da97: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db199da6-ab76-4e1b-98f3-e81f0e02da97', 'volume_size': 1, 'image_id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b23bef189a901542dc0887c3bbc7cec0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2727aad0f0b14a17a82934f950a14e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b7a9756ac4a5d100afca814ecdd50ca5936989d44391734d6fd420274edd7713e9ec3b575e0078714783a0794fc9aeff92100977690231814b0627dc5094f3c', 'id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'created_at': datetime.datetime(2026, 11, 5, 10, 5, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 5, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 11:05:16 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Trying to clone db199da6-ab76-4e1b-98f3-e81f0e02da97 from image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 at location (None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:05:17 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:05:17 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Image download 0.00 MB at 0.00 MB/s Nov 05 11:05:17 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1220f1ae-f32b-438a-88a9-a2eee1d7cf50]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:17 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:17 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:17 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 0 in 0.418s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:17 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:17 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:18 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 1 in 0.738s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Temporary image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 is fetched for user c0f56ed1112a4f8e90921114ef638584. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd80422-2c73-44c7-b8bc-b9406be0f4de]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:18 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:18 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:18 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 0 in 0.464s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:19 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:19 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:19 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 1 in 0.485s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:15Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db199da6-ab76-4e1b-98f3-e81f0e02da97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2727aad0f0b14a17a82934f950a14e41',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:16Z,use_quota=True,user_id='c0f56ed1112a4f8e90921114ef638584',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9a3e85d0-3066-4ed5-a813-a09638f2d0b5),volume_type_id=9a3e85d0-3066-4ed5-a813-a09638f2d0b5)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Creating volume db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:19 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:19 devstack sudo[100824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1073741824 Nov 05 11:05:19 devstack sudo[100824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:19 devstack sudo[100824]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Flow 'volume_create_manager' (d4154d8b-32b5-45fc-b38c-fa3fa67516c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a9ab0-a806-4756-b350-7446d86fc076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1073741824" returned: 0 in 0.681s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f72a9ab0-a806-4756-b350-7446d86fc076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-114114612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd63945-6d36-4dc1-bbb8-9020f7a72563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebcfa21eb1a4a39a5f1061d6f3ea6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:20Z,use_quota=True,user_id='161d2e40f8fd4a11b568bfe4f61d4cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c4fe8c-00af-478d-a530-79e92342ede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00c4fe8c-00af-478d-a530-79e92342ede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e004d2-3ac9-4c48-85d0-113ec7035202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55e004d2-3ac9-4c48-85d0-113ec7035202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcd63945-6d36-4dc1-bbb8-9020f7a72563', 'volume_name': 'volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b000c536-4f36-4cd2-baff-e9a080dbe04e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b000c536-4f36-4cd2-baff-e9a080dbe04e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff0d8ef-56bb-4615-b968-744460ddeff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:20 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Volume dcd63945-6d36-4dc1-bbb8-9020f7a72563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563', 'volume_size': 1} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:20 devstack sudo[100830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 Nov 05 11:05:20 devstack sudo[100830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:20 devstack sudo[100830]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97" returned: 0 in 0.259s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.055s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.300s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-114114612',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcd63945-6d36-4dc1-bbb8-9020f7a72563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ebcfa21eb1a4a39a5f1061d6f3ea6a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:20Z,use_quota=True,user_id='161d2e40f8fd4a11b568bfe4f61d4cb2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Creating volume dcd63945-6d36-4dc1-bbb8-9020f7a72563 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:20 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:20 devstack sudo[100833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 1073741824 Nov 05 11:05:20 devstack sudo[100833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Attempting download of 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 ((None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}])) to volume db199da6-ab76-4e1b-98f3-e81f0e02da97. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f012e83-eee8-4c21-b439-4ca7f4e98fc9]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_ {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:20 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_ Nov 05 11:05:20 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:20 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_ {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:20 devstack sudo[100833]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 1073741824" returned: 0 in 0.618s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:21 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_ Nov 05 11:05:21 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:21 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 Nov 05 11:05:21 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:21 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_" returned: 1 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_4d3_r0r_' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[feef5f37-03e9-4ffc-94e2-756a9562034d]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:21 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff0d8ef-56bb-4615-b968-744460ddeff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fc399e-7894-4673-9935-0abfc568e4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:21 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Volume volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 (dcd63945-6d36-4dc1-bbb8-9020f7a72563): created successfully Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22fc399e-7894-4673-9935-0abfc568e4a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Flow 'volume_create_manager' (d4154d8b-32b5-45fc-b38c-fa3fa67516c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4c7fc771-118a-4250-b386-09f738ddeb01 tempest-AbsoluteLimitsTests-1907013607 None] Created volume successfully. Nov 05 11:05:21 devstack sudo[100851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:21 devstack sudo[100851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:22 devstack sudo[100851]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 0 in 0.644s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:22 devstack sudo[100883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD Nov 05 11:05:22 devstack sudo[100883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:22 devstack sudo[100883]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD" returned: 1 in 0.696s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 was raw, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:22 devstack sudo[100913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 Nov 05 11:05:22 devstack sudo[100913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Acquiring lock "cinder-dcd63945-6d36-4dc1-bbb8-9020f7a72563-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "cinder-dcd63945-6d36-4dc1-bbb8-9020f7a72563-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Acquiring lock "cinder-quobyte-dcd63945-6d36-4dc1-bbb8-9020f7a72563" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "cinder-quobyte-dcd63945-6d36-4dc1-bbb8-9020f7a72563" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[376e6065-4981-49c6-80d0-bfbd515d2f1a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:23 devstack sudo[100924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 Nov 05 11:05:23 devstack sudo[100924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:23 devstack sudo[100913]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97" returned: 0 in 1.124s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:23 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_18e3a7f1-bac9-4786-b8b9-10f2d3b5a500_zc_1smvedevstack@QuobyteHD, size 0.00 MB, duration 1.13 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:05:23 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 11:05:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:23 devstack sudo[100978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1G Nov 05 11:05:23 devstack sudo[100978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:24 devstack sudo[100924]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563" returned: 0 in 1.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:24 devstack sudo[100987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563 Nov 05 11:05:24 devstack sudo[100987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:24 devstack sudo[100978]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 1G" returned: 0 in 1.088s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Downloaded image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 ((None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}])) to volume db199da6-ab76-4e1b-98f3-e81f0e02da97 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Temporary image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 for user c0f56ed1112a4f8e90921114ef638584 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Marking volume db199da6-ab76-4e1b-98f3-e81f0e02da97 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Copying metadata from image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 to db199da6-ab76-4e1b-98f3-e81f0e02da97. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:05:24 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Creating volume glance metadata for volume db199da6-ab76-4e1b-98f3-e81f0e02da97 backed by image 18e3a7f1-bac9-4786-b8b9-10f2d3b5a500 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'b23bef189a901542dc0887c3bbc7cec0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:05:25 devstack sudo[100987]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-dcd63945-6d36-4dc1-bbb8-9020f7a72563" returned: 0 in 0.675s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "cinder-quobyte-dcd63945-6d36-4dc1-bbb8-9020f7a72563" released by "delete_volume" :: held 2.093s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2cc91e3-4c72-4619-9a03-51837f4b11d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db199da6-ab76-4e1b-98f3-e81f0e02da97', 'volume_size': 1, 'image_id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'b23bef189a901542dc0887c3bbc7cec0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '2727aad0f0b14a17a82934f950a14e41', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '0b7a9756ac4a5d100afca814ecdd50ca5936989d44391734d6fd420274edd7713e9ec3b575e0078714783a0794fc9aeff92100977690231814b0627dc5094f3c', 'id': '18e3a7f1-bac9-4786-b8b9-10f2d3b5a500', 'created_at': datetime.datetime(2026, 11, 5, 10, 5, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 5, 13, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/18e3a7f1-bac9-4786-b8b9-10f2d3b5a500/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31669e1-c02a-47a8-a411-7250d9124d19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Volume volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 (db199da6-ab76-4e1b-98f3-e81f0e02da97): created successfully Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b31669e1-c02a-47a8-a411-7250d9124d19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Flow 'volume_create_manager' (8c1e6164-c67c-44f8-bdc9-0227bd821997) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cbce3fca-7204-4662-8b8c-1c4f81149497 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Created volume successfully. Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Created reservations ['3bd7b60c-bf80-4762-ba31-4ecbcae0157a', '05d02b46-bf0b-4fee-9a38-c40f80f47666', 'c988f84c-8372-4896-a207-b53262a06db3', 'dc7260b0-cd05-4fbe-bc63-ed34198d1027'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:25 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:05:25 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:25 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.352s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:05:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Deleted volume successfully. Nov 05 11:05:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-38c0c763-d3b6-4694-8ebe-b528b81049f0 tempest-AbsoluteLimitsTests-1907013607 None] Lock "cinder-dcd63945-6d36-4dc1-bbb8-9020f7a72563-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Acquiring lock "cinder-db199da6-ab76-4e1b-98f3-e81f0e02da97-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "cinder-db199da6-ab76-4e1b-98f3-e81f0e02da97-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Acquiring lock "cinder-quobyte-db199da6-ab76-4e1b-98f3-e81f0e02da97" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "cinder-quobyte-db199da6-ab76-4e1b-98f3-e81f0e02da97" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5cb0c72-9772-47db-8c93-ca1dbad8a558]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:26 devstack sudo[100998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 Nov 05 11:05:26 devstack sudo[100998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6aa06210-259d-4da8-b7a6-1b4fc42ccc0a tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" by "attach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6aa06210-259d-4da8-b7a6-1b4fc42ccc0a tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" acquired by "attach_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6aa06210-259d-4da8-b7a6-1b4fc42ccc0a tempest-VolumesActionsTest-1655116761 None] Attaching volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408 to instance 122ed58b-387e-4b5d-a518-d8c5ec63b84d at mountpoint /dev/vdb on host None. Nov 05 11:05:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6aa06210-259d-4da8-b7a6-1b4fc42ccc0a tempest-VolumesActionsTest-1655116761 None] Attach volume completed successfully. Nov 05 11:05:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6aa06210-259d-4da8-b7a6-1b4fc42ccc0a tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" released by "attach_volume" :: held 0.157s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:27 devstack sudo[100998]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97" returned: 0 in 0.796s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:27 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97 Nov 05 11:05:27 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d69ea6a4-76ae-48e1-acfa-8de831a19533 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" by "detach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d69ea6a4-76ae-48e1-acfa-8de831a19533 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" acquired by "detach_volume" :: waited 0.046s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:27 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d69ea6a4-76ae-48e1-acfa-8de831a19533 tempest-VolumesActionsTest-1655116761 None] Detaching volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408 from instance 122ed58b-387e-4b5d-a518-d8c5ec63b84d. Nov 05 11:05:27 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d69ea6a4-76ae-48e1-acfa-8de831a19533 tempest-VolumesActionsTest-1655116761 None] Detach volume completed successfully. Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d69ea6a4-76ae-48e1-acfa-8de831a19533 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" released by "detach_volume" :: held 0.148s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:27 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-db199da6-ab76-4e1b-98f3-e81f0e02da97" returned: 0 in 0.546s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "cinder-quobyte-db199da6-ab76-4e1b-98f3-e81f0e02da97" released by "delete_volume" :: held 1.446s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:27 devstack cinder-volume[87369]: WARNING cinder.quota [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:05:27 devstack cinder-volume[87369]: WARNING cinder.quota [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 05 11:05:27 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Created reservations ['c7bf993a-799f-4449-aeaa-0450a5bed0a0', 'f7ab6fd7-c02f-4d0d-8fb7-30d29fbd16fc', '7bb233c1-0409-43d5-8f10-7743ea8728da', '65709f12-0aa0-4e93-8a8c-f87bf1098a23'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:29 devstack sudo[101030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:05:29 devstack sudo[101030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:29 devstack sudo[101030]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:29 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:05:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Deleted volume successfully. Nov 05 11:05:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a6dbb2b8-4d61-4a7b-9aca-46a09aa37591 tempest-VolumeAndVolumeTypeFromImageTest-1494066950 None] Lock "cinder-db199da6-ab76-4e1b-98f3-e81f0e02da97-delete_volume" released by "delete_volume" :: held 6.484s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:38 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=37,cinder:UPDATE=36,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:05:39 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=40,cinder:SELECT=33,cinder:DELETE=2,cinder:INSERT=13 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Flow 'volume_create_manager' (efa8d65e-2339-42f4-8e4d-e79dd8edb6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460cd5e7-6bd0-4c51-8982-4b36f9ddb051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (460cd5e7-6bd0-4c51-8982-4b36f9ddb051) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197518964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27f4ea-7b90-4792-95b0-3344f5958244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78bfe47730d44eedbb12665f3efa034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:42Z,use_quota=True,user_id='2bf7483b23a749fabaca3d07222d4a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929e4bd3-db7b-4d7d-8199-0bbd49f712c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (929e4bd3-db7b-4d7d-8199-0bbd49f712c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f6361-a39e-4272-ba13-c21ef3df0bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5f6361-a39e-4272-ba13-c21ef3df0bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de27f4ea-7b90-4792-95b0-3344f5958244', 'volume_name': 'volume-de27f4ea-7b90-4792-95b0-3344f5958244', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fd8218-ea10-48f9-b26b-1afa20b98f8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97fd8218-ea10-48f9-b26b-1afa20b98f8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874dcc65-e5a9-4db7-a5db-eb38176bf674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Volume de27f4ea-7b90-4792-95b0-3344f5958244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de27f4ea-7b90-4792-95b0-3344f5958244', 'volume_size': 1} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-197518964',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de27f4ea-7b90-4792-95b0-3344f5958244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78bfe47730d44eedbb12665f3efa034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:42Z,use_quota=True,user_id='2bf7483b23a749fabaca3d07222d4a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Creating volume de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:42 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:42 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 1073741824 Nov 05 11:05:42 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Flow 'volume_create_manager' (46ceee2a-3242-4c08-ab53-086fc47220ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30c364b-d8ce-4d81-8c61-66e3c0aad21c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c30c364b-d8ce-4d81-8c61-66e3c0aad21c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1774602878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d58c2b-6004-4504-a941-b59fedcc4923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5806a04d23b64bf58be4ccfa203e0135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:42Z,use_quota=True,user_id='81b7fb13ff2143a2a3f2ad2954e84086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d13e6b4-2eac-41b4-a3bd-1e9c29c0b35b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d13e6b4-2eac-41b4-a3bd-1e9c29c0b35b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21794d25-6604-4df4-8467-f91327a4f703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21794d25-6604-4df4-8467-f91327a4f703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8d58c2b-6004-4504-a941-b59fedcc4923', 'volume_name': 'volume-b8d58c2b-6004-4504-a941-b59fedcc4923', 'volume_size': 2}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8745d94e-274a-4274-a9aa-d1b136acb174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8745d94e-274a-4274-a9aa-d1b136acb174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f26d8e3-f9e4-4ec0-8e52-a52187e55dc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Volume b8d58c2b-6004-4504-a941-b59fedcc4923: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8d58c2b-6004-4504-a941-b59fedcc4923', 'volume_size': 2} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:42 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 1073741824" returned: 0 in 0.554s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:42 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:05:42 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:42 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] <== create_volume: return (882ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1774602878',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8d58c2b-6004-4504-a941-b59fedcc4923,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5806a04d23b64bf58be4ccfa203e0135',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:42Z,use_quota=True,user_id='81b7fb13ff2143a2a3f2ad2954e84086',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Creating volume b8d58c2b-6004-4504-a941-b59fedcc4923 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 2147483648 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (874dcc65-e5a9-4db7-a5db-eb38176bf674) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de27f4ea-7b90-4792-95b0-3344f5958244', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cb3f18-d6df-4915-b0c0-7636ad0251c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:43 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 2147483648 Nov 05 11:05:43 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Volume volume-de27f4ea-7b90-4792-95b0-3344f5958244 (de27f4ea-7b90-4792-95b0-3344f5958244): created successfully Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04cb3f18-d6df-4915-b0c0-7636ad0251c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Flow 'volume_create_manager' (efa8d65e-2339-42f4-8e4d-e79dd8edb6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c60e55bc-dc1b-46c8-be83-1f231dd7b81f tempest-VolumeDependencyTests-2055333464 None] Created volume successfully. Nov 05 11:05:43 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 2147483648" returned: 0 in 0.671s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:43 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 Nov 05 11:05:43 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:44 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923" returned: 0 in 0.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] <== create_volume: return (1314ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.318s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f26d8e3-f9e4-4ec0-8e52-a52187e55dc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8d58c2b-6004-4504-a941-b59fedcc4923', 'volume_size': 2}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceab579-5db8-4e69-9e14-3bac831113f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Volume volume-b8d58c2b-6004-4504-a941-b59fedcc4923 (b8d58c2b-6004-4504-a941-b59fedcc4923): created successfully Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cceab579-5db8-4e69-9e14-3bac831113f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Flow 'volume_create_manager' (46ceee2a-3242-4c08-ab53-086fc47220ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-696cf567-2b05-4cc1-9839-c92e4a39f1fb tempest-VolumesCloneNegativeTest-603008476 None] Created volume successfully. Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Creating offline snapshot 5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 of volume de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9e8839-e834-49ef-ac68-9e0073335cf7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:44 devstack sudo[101119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:05:44 devstack sudo[101119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:45 devstack sudo[101119]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.608s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:45 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 1G Nov 05 11:05:45 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Acquiring lock "cinder-b8d58c2b-6004-4504-a941-b59fedcc4923-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "cinder-b8d58c2b-6004-4504-a941-b59fedcc4923-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Acquiring lock "cinder-quobyte-b8d58c2b-6004-4504-a941-b59fedcc4923" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "cinder-quobyte-b8d58c2b-6004-4504-a941-b59fedcc4923" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[573de6c4-ddb1-4bbf-a7ba-a593a918b00d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:46 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 Nov 05 11:05:46 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:46 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 1G" returned: 0 in 0.996s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de27f4ea-7b90-4792-95b0-3344f5958244 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:46 devstack sudo[101160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de27f4ea-7b90-4792-95b0-3344f5958244 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:05:46 devstack sudo[101160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:46 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923" returned: 0 in 0.697s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:46 devstack sudo[101165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923 Nov 05 11:05:46 devstack sudo[101165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:47 devstack sudo[101160]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-de27f4ea-7b90-4792-95b0-3344f5958244 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.890s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:47 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 is being set with open permissions: ugo+rw Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:47 devstack sudo[101171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:05:47 devstack sudo[101171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:47 devstack sudo[101165]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b8d58c2b-6004-4504-a941-b59fedcc4923" returned: 0 in 0.790s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "cinder-quobyte-b8d58c2b-6004-4504-a941-b59fedcc4923" released by "delete_volume" :: held 1.573s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Created reservations ['ea027d54-eca8-415c-bb4d-93d3a9d4d746', '0726738b-2015-436b-b64a-aefdc8087ae6', '0f29d392-9d63-4714-ab70-266ca992fbac', 'ffca50b2-c06f-4cac-a25e-a36099062717'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:05:47 devstack sudo[101171]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:47 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info Nov 05 11:05:47 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:47 devstack sudo[101178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:05:47 devstack sudo[101178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b29d457d-2472-47c0-ad1c-e9cbdf7e5eed tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" by "attach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b29d457d-2472-47c0-ad1c-e9cbdf7e5eed tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" acquired by "attach_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b29d457d-2472-47c0-ad1c-e9cbdf7e5eed tempest-VolumesActionsTest-1655116761 None] Attaching volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408 to instance bf9dff99-d245-4c8a-b99d-70421b6fa526 at mountpoint /dev/vdb on host None. Nov 05 11:05:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b29d457d-2472-47c0-ad1c-e9cbdf7e5eed tempest-VolumesActionsTest-1655116761 None] Attach volume completed successfully. Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b29d457d-2472-47c0-ad1c-e9cbdf7e5eed tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408" released by "attach_volume" :: held 0.190s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:48 devstack sudo[101178]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.341s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:05:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Deleted volume successfully. Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a26f0621-eb4c-428b-9f85-e3d480ec395c tempest-VolumesCloneNegativeTest-603008476 None] Lock "cinder-b8d58c2b-6004-4504-a941-b59fedcc4923-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:48 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info" returned: 0 in 0.584s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:48 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info is being set with open permissions: ugo+rw Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:48 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info Nov 05 11:05:48 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:48 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.info" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.122s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ebc113b9-bb00-4a5a-ac34-473371796cb8 tempest-VolumeDependencyTests-2055333464 None] Create snapshot completed successfully Nov 05 11:05:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47841762-f592-4f87-9a41-b30ccec24a8a tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" by "detach_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47841762-f592-4f87-9a41-b30ccec24a8a tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-47841762-f592-4f87-9a41-b30ccec24a8a tempest-VolumesActionsTest-1655116761 None] Detaching volume 15e8b732-39e8-48cc-89bf-b2c45fe2b408 from instance bf9dff99-d245-4c8a-b99d-70421b6fa526. Nov 05 11:05:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-47841762-f592-4f87-9a41-b30ccec24a8a tempest-VolumesActionsTest-1655116761 None] Detach volume completed successfully. Nov 05 11:05:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-47841762-f592-4f87-9a41-b30ccec24a8a tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:50 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:05:50 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:50 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.325s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Flow 'volume_create_manager' (eed039c1-8963-4277-9463-c27b16a842b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0830cb6-7157-4c44-b76a-3f53314bb5f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0830cb6-7157-4c44-b76a-3f53314bb5f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-733145630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4570e2fa-9002-4859-8bf7-8bc316e73bc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78bfe47730d44eedbb12665f3efa034e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=5f8c927a-a776-4cbf-9d25-66ca4cd35cc8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:51Z,use_quota=True,user_id='2bf7483b23a749fabaca3d07222d4a98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee4df2-d23e-44c6-861e-fa4a393a97a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55ee4df2-d23e-44c6-861e-fa4a393a97a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0530b34-aab3-4fdb-ac31-289355f6e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0530b34-aab3-4fdb-ac31-289355f6e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4570e2fa-9002-4859-8bf7-8bc316e73bc8', 'volume_name': 'volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8', 'volume_size': 1, 'snapshot_id': '5f8c927a-a776-4cbf-9d25-66ca4cd35cc8'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90ee9a-0e72-4fed-bf39-8bd4ccc17824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f90ee9a-0e72-4fed-bf39-8bd4ccc17824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193ba38e-dbdb-4175-8bca-82d04db7053d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Volume 4570e2fa-9002-4859-8bf7-8bc316e73bc8: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8', 'volume_size': 1, 'snapshot_id': '5f8c927a-a776-4cbf-9d25-66ca4cd35cc8'} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-4570e2fa-9002-4859-8bf7-8bc316e73bc8" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-4570e2fa-9002-4859-8bf7-8bc316e73bc8" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Creating volume 4570e2fa-9002-4859-8bf7-8bc316e73bc8 from snapshot 5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] snapshot: 5f8c927a-a776-4cbf-9d25-66ca4cd35cc8, volume: 4570e2fa-9002-4859-8bf7-8bc316e73bc8, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea2807a-f49d-466c-bf49-dfad7162b30b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:51 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:05:51 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:51 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.672s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de27f4ea-7b90-4792-95b0-3344f5958244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:05:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1129d2b4-f37a-41f8-b2e7-ea1091e996a7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:05:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:51 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:05:51 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:52 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Nov 05 11:05:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.539s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:05:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:05:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:05:52 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:05:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:05:52 devstack sudo[101223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 Nov 05 11:05:52 devstack sudo[101223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (7887b34d-ec27-4add-ac46-c504bb00f926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee467db3-d7c2-492c-9837-87d8b8941102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee467db3-d7c2-492c-9837-87d8b8941102) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1001127577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12cde65-feb4-4f34-812e-e0ddee6235b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:56Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f425a-2ab0-4339-af60-cf90daa4cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f425a-2ab0-4339-af60-cf90daa4cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4877a3a6-d03f-4e64-8aad-0d9307915a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4877a3a6-d03f-4e64-8aad-0d9307915a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a12cde65-feb4-4f34-812e-e0ddee6235b1', 'volume_name': 'volume-a12cde65-feb4-4f34-812e-e0ddee6235b1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc27a06-5baf-424f-9d5c-d9363b69ecfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3dc27a06-5baf-424f-9d5c-d9363b69ecfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c65f09-ee68-4416-a648-61983f55a1b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:05:56 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Volume a12cde65-feb4-4f34-812e-e0ddee6235b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a12cde65-feb4-4f34-812e-e0ddee6235b1', 'volume_size': 1} Nov 05 11:05:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:05:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:00 devstack sudo[101223]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8" returned: 0 in 8.430s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244, size 1024.00 MB, duration 8.43 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:00 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Converted 1024.00 MB image at 121.45 MB/s Nov 05 11:06:00 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 is being set with open permissions: ugo+rw Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:00 devstack sudo[101237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 Nov 05 11:06:00 devstack sudo[101237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:00 devstack sudo[101237]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" released by "_copy_volume_from_snapshot" :: held 10.026s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-4570e2fa-9002-4859-8bf7-8bc316e73bc8" released by "_create_volume_from_snapshot" :: held 10.100s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.118s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.589s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:05:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1001127577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a12cde65-feb4-4f34-812e-e0ddee6235b1,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:05:56Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Creating volume a12cde65-feb4-4f34-812e-e0ddee6235b1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:06:00 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:06:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:01 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 1073741824 Nov 05 11:06:01 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (193ba38e-dbdb-4175-8bca-82d04db7053d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8', 'volume_size': 1, 'snapshot_id': '5f8c927a-a776-4cbf-9d25-66ca4cd35cc8'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c41806-6dc7-4c9f-ace3-23315fd9910d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:01 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Volume volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 (4570e2fa-9002-4859-8bf7-8bc316e73bc8): created successfully Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (95c41806-6dc7-4c9f-ace3-23315fd9910d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Flow 'volume_create_manager' (eed039c1-8963-4277-9463-c27b16a842b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f6b511f1-8c29-45fa-9ee9-ccf8d13a2f46 tempest-VolumeDependencyTests-2055333464 None] Created volume successfully. Nov 05 11:06:01 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 1073741824" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:01 devstack sudo[101246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 Nov 05 11:06:01 devstack sudo[101246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:01 devstack sudo[101246]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.814s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79c65f09-ee68-4416-a648-61983f55a1b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a12cde65-feb4-4f34-812e-e0ddee6235b1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ee43c4-a21f-4cd2-8a2d-4dde3f96641c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[74949061-4f1d-4f68-8acd-4896732450f2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:01 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Volume volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 (a12cde65-feb4-4f34-812e-e0ddee6235b1): created successfully Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87ee43c4-a21f-4cd2-8a2d-4dde3f96641c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (7887b34d-ec27-4add-ac46-c504bb00f926) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-69f4679a-72a5-4726-8d72-f8f19333ad22 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Deleting offline snapshot 5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 of volume de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:06:01 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:01 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] snapshot_file for this snap is: volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e853b0df-476c-4632-901b-ef6b282a6a4c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:02 devstack sudo[101251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:06:02 devstack sudo[101251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:02 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.484s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf0a4a1-6323-4a0f-8e33-1f4ca21e120b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:02 devstack sudo[101251]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.420s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:02 devstack sudo[101256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-de27f4ea-7b90-4792-95b0-3344f5958244(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:06:02 devstack sudo[101256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d14cc97-d160-4c17-9780-1c21fcde1aa6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:02 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:06:02 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:02 devstack sudo[101256]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.395a6a61-d991-40e2-9523-5a7c8f7aa69f_qj2lu47.img {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:02 devstack sudo[101267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.395a6a61-d991-40e2-9523-5a7c8f7aa69f_qj2lu47.img Nov 05 11:06:02 devstack sudo[101267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:03 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.829s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:03 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:06:03 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:04 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.881s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:04 devstack sudo[101288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8 Nov 05 11:06:04 devstack sudo[101288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:06:04 devstack sudo[101288]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (ae663782-8060-42a4-8a22-648d2f0e39d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90d3abd-23f0-4f3a-ad81-07aa9843343c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244.5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" returned: 0 in 0.429s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f90d3abd-23f0-4f3a-ad81-07aa9843343c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249628767',display_name='tempest-VolumesGetTest-Volume-640802102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c654bbd-04fb-49e4-8b59-5095ff547035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:04Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab58605f-16ba-40e1-b1fb-845769d6b915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab58605f-16ba-40e1-b1fb-845769d6b915) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34917070-219d-4b35-b745-27bfad7be48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34917070-219d-4b35-b745-27bfad7be48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c654bbd-04fb-49e4-8b59-5095ff547035', 'volume_name': 'volume-8c654bbd-04fb-49e4-8b59-5095ff547035', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93a4908-674f-42e8-b6be-850bf7dfeaaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f93a4908-674f-42e8-b6be-850bf7dfeaaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d714e1cd-b7b2-4064-8f14-cb0848af906e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:04 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Volume 8c654bbd-04fb-49e4-8b59-5095ff547035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c654bbd-04fb-49e4-8b59-5095ff547035', 'volume_size': 1} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8" released by "_delete_snapshot" :: held 2.834s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" released by "delete_snapshot" :: held 2.867s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:04 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Created reservations ['c6c152e6-d910-453e-bb74-3964d91c2fdf', 'b629b147-af75-4290-86a1-cc36ddd9a4f6', 'c91a257e-6430-4807-8994-59344920afb1', 'b5c1b97c-ec7d-4ba1-b481-24791db5ef60'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Delete snapshot completed successfully. Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9423f587-dab6-4566-99f9-144948591069 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-5f8c927a-a776-4cbf-9d25-66ca4cd35cc8-delete_snapshot" released by "delete_snapshot" :: held 3.178s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-de27f4ea-7b90-4792-95b0-3344f5958244-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-de27f4ea-7b90-4792-95b0-3344f5958244-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[45386475-54d0-4c59-a418-c8e2ebea75f3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:05 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:06:05 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:06 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.648s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:06 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244 Nov 05 11:06:06 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:06 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-de27f4ea-7b90-4792-95b0-3344f5958244" returned: 0 in 0.539s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-de27f4ea-7b90-4792-95b0-3344f5958244" released by "delete_volume" :: held 1.337s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:06 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Created reservations ['ff14af32-f1a0-43f7-98e2-bb2c2b5cd1d2', '2d39dfa8-564c-4b46-a16f-39e1d79d28cc', 'd243a0c6-9f79-4ea1-b235-033f440b7488', '9dbb95af-9086-47d3-8765-2ac44dde5bdf'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:07 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:07 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:07 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.450s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:07 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Deleted volume successfully. Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17676386-a8b6-4dcb-8545-5d0506289b7a tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-de27f4ea-7b90-4792-95b0-3344f5958244-delete_volume" released by "delete_volume" :: held 2.197s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-4570e2fa-9002-4859-8bf7-8bc316e73bc8-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-4570e2fa-9002-4859-8bf7-8bc316e73bc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:08 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[54c90e38-3839-419c-baf3-5150ce533033]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:08 devstack sudo[101312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 Nov 05 11:06:08 devstack sudo[101312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:08 devstack sudo[101312]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8" returned: 0 in 0.760s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:08 devstack sudo[101318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8 Nov 05 11:06:08 devstack sudo[101318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:09 devstack sudo[101318]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4570e2fa-9002-4859-8bf7-8bc316e73bc8" returned: 0 in 0.537s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-quobyte-4570e2fa-9002-4859-8bf7-8bc316e73bc8" released by "delete_volume" :: held 1.389s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Created reservations ['98eb2e48-fcdb-4c7b-b980-1821b32923bd', 'd5e83694-3a7b-4ef3-86ea-439609da9adf', '4c6b14f7-b83c-4c57-9a2b-e0c15a13a606', '65361d15-fa93-48d4-bb25-0e07b1656030'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:09 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:09 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:10 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.547s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Deleted volume successfully. Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2d981a3e-c1a8-4082-9547-8d296e7e3135 tempest-VolumeDependencyTests-2055333464 None] Lock "cinder-4570e2fa-9002-4859-8bf7-8bc316e73bc8-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:10 devstack sudo[101267]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.395a6a61-d991-40e2-9523-5a7c8f7aa69f_qj2lu47.img" returned: 0 in 7.896s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6e1798-eba3-427d-82db-044ae87a8e3b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:10 devstack sudo[101324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:10 devstack sudo[101324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:11 devstack sudo[101324]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.754s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:11 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408, size 1024.00 MB, duration 7.90 sec, destination /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.395a6a61-d991-40e2-9523-5a7c8f7aa69f_qj2lu47.img {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:11 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Converted 1024.00 MB image at 129.68 MB/s Nov 05 11:06:11 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] 395a6a61-d991-40e2-9523-5a7c8f7aa69f was raw, no need to convert to raw {{(pid=87369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Flow 'volume_create_manager' (14ed55b4-f32a-462d-b960-3a8d5504634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc442312-3574-46bf-b991-b7ab8a55cfcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Flow 'volume_create_manager' (43516a2c-60db-415b-b0c6-61cab77ddaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5778ca-783c-42c9-8551-225ce323a3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc442312-3574-46bf-b991-b7ab8a55cfcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5555273-8468-4612-a5cc-c0836b2e2a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1caadadc1d44dea2cdf9e3d781deb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:19Z,use_quota=True,user_id='840fa56a687949d9ae089eb6a11a2313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69084017-f286-47a8-83e6-3d03fcbd5a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69084017-f286-47a8-83e6-3d03fcbd5a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7c2c73-141b-47ee-a5d6-371889825b63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc5778ca-783c-42c9-8551-225ce323a3e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-310481059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af027e4-7a4d-48d0-9c3a-e6b922afd8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb56d248c64f4236835d724d30c114d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:19Z,use_quota=True,user_id='862be39845e04935b84fe210767a1e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42781f34-3767-4891-b6eb-214958ccced6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42781f34-3767-4891-b6eb-214958ccced6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18ef85-fa09-4899-9812-ddd893bd9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb18ef85-fa09-4899-9812-ddd893bd9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af027e4-7a4d-48d0-9c3a-e6b922afd8cc', 'volume_name': 'volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588c5aa3-6840-4ee7-991c-7d8aedb5d45f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (588c5aa3-6840-4ee7-991c-7d8aedb5d45f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177c7c91-34f4-4108-be1a-5da14b8f3731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Volume 8af027e4-7a4d-48d0-9c3a-e6b922afd8cc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc', 'volume_size': 1} Nov 05 11:06:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b7c2c73-141b-47ee-a5d6-371889825b63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd5555273-8468-4612-a5cc-c0836b2e2a92', 'volume_name': 'volume-d5555273-8468-4612-a5cc-c0836b2e2a92', 'volume_size': 1, 'image_id': '0b46711d-1f83-4664-accf-e72dddab950a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ad7182695090595874820eff75ff69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e1caadadc1d44dea2cdf9e3d781deb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae3bf6e1dddf6468d0331764c0ddc45889d7ba8f5d20ba84346b14fd8cd9c2de86fe9259e2c21e3c03cc4df67ecbd998097e9eb2ec155d25f55f136a149aaded', 'id': '0b46711d-1f83-4664-accf-e72dddab950a', 'created_at': datetime.datetime(2026, 11, 5, 10, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b46711d-1f83-4664-accf-e72dddab950a/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c0bb99-9ef6-4f06-b064-6bfd5e46f722) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83c0bb99-9ef6-4f06-b064-6bfd5e46f722) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea303be3-a280-4be9-8896-22f0cc2947d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Volume d5555273-8468-4612-a5cc-c0836b2e2a92: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d5555273-8468-4612-a5cc-c0836b2e2a92', 'volume_size': 1, 'image_id': '0b46711d-1f83-4664-accf-e72dddab950a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ad7182695090595874820eff75ff69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e1caadadc1d44dea2cdf9e3d781deb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae3bf6e1dddf6468d0331764c0ddc45889d7ba8f5d20ba84346b14fd8cd9c2de86fe9259e2c21e3c03cc4df67ecbd998097e9eb2ec155d25f55f136a149aaded', 'id': '0b46711d-1f83-4664-accf-e72dddab950a', 'created_at': datetime.datetime(2026, 11, 5, 10, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b46711d-1f83-4664-accf-e72dddab950a/file', 'properties': {}}, 'image_service': } Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Trying to clone d5555273-8468-4612-a5cc-c0836b2e2a92 from image 0b46711d-1f83-4664-accf-e72dddab950a at location (None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:06:19 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Image download 0.00 MB at 0.00 MB/s Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741da5d-5f53-45b0-a052-f5de6c1fdef8]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:19 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:19 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:19 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:19 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:19 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:19 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 1 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Temporary image 0b46711d-1f83-4664-accf-e72dddab950a is fetched for user 840fa56a687949d9ae089eb6a11a2313. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d751da-5a03-46ff-854c-f181f08120e5]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:20 devstack sudo[101340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:20 devstack sudo[101340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:20 devstack sudo[101340]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:20 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:20 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:20 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 1 in 0.358s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:06:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:29 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=42,cinder:UPDATE=54,cinder:DELETE=4,cinder:INSERT=12 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:06:29 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=41,cinder:SELECT=49,cinder:INSERT=12,cinder:DELETE=4 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 31.877s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Uploaded volume to glance image-id: 395a6a61-d991-40e2-9523-5a7c8f7aa69f. {{(pid=87369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 28.926s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:04Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-249628767',display_name='tempest-VolumesGetTest-Volume-640802102',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c654bbd-04fb-49e4-8b59-5095ff547035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:04Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Creating volume 8c654bbd-04fb-49e4-8b59-5095ff547035 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:06:33 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:06:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:33 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 1073741824 Nov 05 11:06:33 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1260128b-f30d-471b-a218-5dff43e32b51 tempest-VolumesActionsTest-1655116761 None] Copy volume to image completed successfully. Nov 05 11:06:34 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 1073741824" returned: 0 in 0.483s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:34 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 Nov 05 11:06:34 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:34 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035" returned: 0 in 0.280s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] <== create_volume: return (814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.716s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-310481059',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af027e4-7a4d-48d0-9c3a-e6b922afd8cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb56d248c64f4236835d724d30c114d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:19Z,use_quota=True,user_id='862be39845e04935b84fe210767a1e9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Creating volume 8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:06:34 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d714e1cd-b7b2-4064-8f14-cb0848af906e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c654bbd-04fb-49e4-8b59-5095ff547035', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5ee7a-2cfa-4a82-ae4e-e38f767a1cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:34 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc 1073741824 Nov 05 11:06:34 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:34 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Volume volume-8c654bbd-04fb-49e4-8b59-5095ff547035 (8c654bbd-04fb-49e4-8b59-5095ff547035): created successfully Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae5ee7a-2cfa-4a82-ae4e-e38f767a1cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (ae663782-8060-42a4-8a22-648d2f0e39d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7cebfe9e-dc5e-4eb0-9602-92d0c3c59d10 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:06:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:35 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc 1073741824" returned: 0 in 0.490s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:35 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:06:35 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:35 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.244s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.596s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5555273-8468-4612-a5cc-c0836b2e2a92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e1caadadc1d44dea2cdf9e3d781deb9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:19Z,use_quota=True,user_id='840fa56a687949d9ae089eb6a11a2313',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Creating volume d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:06:35 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (177c7c91-34f4-4108-be1a-5da14b8f3731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1a50ac-0186-48b9-a3c3-5cb836e360ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:35 devstack sudo[101406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1073741824 Nov 05 11:06:35 devstack sudo[101406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Volume volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc (8af027e4-7a4d-48d0-9c3a-e6b922afd8cc): created successfully Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a1a50ac-0186-48b9-a3c3-5cb836e360ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Flow 'volume_create_manager' (43516a2c-60db-415b-b0c6-61cab77ddaa8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-28333cae-4848-478a-8f5c-485a1bbb6a4a tempest-TestImageHashVerification-1261122766 None] Created volume successfully. Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-8c654bbd-04fb-49e4-8b59-5095ff547035-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "cinder-8c654bbd-04fb-49e4-8b59-5095ff547035-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:35 devstack sudo[101406]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1073741824" returned: 0 in 0.576s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-8c654bbd-04fb-49e4-8b59-5095ff547035" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-8c654bbd-04fb-49e4-8b59-5095ff547035" acquired by "delete_volume" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[937d3aca-92a6-4dff-b2dc-1888a2dd45c2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:35 devstack sudo[101412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 Nov 05 11:06:35 devstack sudo[101412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:36 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 Nov 05 11:06:36 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:36 devstack sudo[101412]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92" returned: 0 in 0.320s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 1.396s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94ff29a-de5a-4649-9f39-fe316f983aaf]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Attempting download of 0b46711d-1f83-4664-accf-e72dddab950a ((None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}])) to volume d5555273-8468-4612-a5cc-c0836b2e2a92. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9304df6-b6b7-40c0-8707-070e4b19c6cf]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:36 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:36 devstack sudo[101417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:36 devstack sudo[101417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:36 devstack sudo[101422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035 Nov 05 11:06:36 devstack sudo[101422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:36 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb Nov 05 11:06:36 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:36 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb" returned: 0 in 0.385s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:36 devstack sudo[101422]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8c654bbd-04fb-49e4-8b59-5095ff547035" returned: 0 in 0.369s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:36 devstack sudo[101417]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-8c654bbd-04fb-49e4-8b59-5095ff547035" released by "delete_volume" :: held 0.924s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.539s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda21e13-f550-402d-a1ea-fb9591376ee5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:36 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Created reservations ['1555f5a0-3cef-4a44-87d1-2045049fa59a', 'd87b84d3-f5ea-4b01-a808-8eef7c6734e2', 'b14940d0-3781-41f3-bb6b-465157abe6bf', 'b8f7667b-4143-4edb-9c0f-99fb7bab2508'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:36 devstack sudo[101434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb Nov 05 11:06:36 devstack sudo[101434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:37 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:37 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:37 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:37 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:37 devstack sudo[101434]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb" returned: 1 in 0.403s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0b46711d-1f83-4664-accf-e72dddab950a_4qawh5mb' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e708b1-fb47-4a7c-9978-5c0908d066ed]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:37 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:37 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:37 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.457s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:37 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.307s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:06:37 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img Nov 05 11:06:37 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-be0bd612-a64a-4db2-be1a-85669676618b tempest-VolumesGetTest-1169072910 None] Lock "cinder-8c654bbd-04fb-49e4-8b59-5095ff547035-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:37 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:37 devstack sudo[101455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD Nov 05 11:06:37 devstack sudo[101455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:38 devstack sudo[101455]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD" returned: 1 in 0.742s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] 0b46711d-1f83-4664-accf-e72dddab950a was raw, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:38 devstack sudo[101469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 Nov 05 11:06:38 devstack sudo[101469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-a12cde65-feb4-4f34-812e-e0ddee6235b1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "cinder-a12cde65-feb4-4f34-812e-e0ddee6235b1-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-a12cde65-feb4-4f34-812e-e0ddee6235b1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-a12cde65-feb4-4f34-812e-e0ddee6235b1" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[98e88ae9-487d-4e26-a5ca-759ddd4677fb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:39 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 Nov 05 11:06:39 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:39 devstack sudo[101469]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92" returned: 0 in 1.079s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:39 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0b46711d-1f83-4664-accf-e72dddab950a_qjav3jvtdevstack@QuobyteHD, size 0.00 MB, duration 1.09 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:39 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 11:06:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:39 devstack sudo[101476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1G Nov 05 11:06:39 devstack sudo[101476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:39 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1" returned: 0 in 0.757s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:39 devstack sudo[101483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1 Nov 05 11:06:39 devstack sudo[101483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:40 devstack sudo[101483]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:40 devstack sudo[101476]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 1G" returned: 0 in 0.778s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Downloaded image 0b46711d-1f83-4664-accf-e72dddab950a ((None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}])) to volume d5555273-8468-4612-a5cc-c0836b2e2a92 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Temporary image 0b46711d-1f83-4664-accf-e72dddab950a for user 840fa56a687949d9ae089eb6a11a2313 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Marking volume d5555273-8468-4612-a5cc-c0836b2e2a92 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a12cde65-feb4-4f34-812e-e0ddee6235b1" returned: 0 in 0.552s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Copying metadata from image 0b46711d-1f83-4664-accf-e72dddab950a to d5555273-8468-4612-a5cc-c0836b2e2a92. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Creating volume glance metadata for volume d5555273-8468-4612-a5cc-c0836b2e2a92 backed by image 0b46711d-1f83-4664-accf-e72dddab950a with: {'image_id': '0b46711d-1f83-4664-accf-e72dddab950a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c1ad7182695090595874820eff75ff69', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-a12cde65-feb4-4f34-812e-e0ddee6235b1" released by "delete_volume" :: held 1.415s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea303be3-a280-4be9-8896-22f0cc2947d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5555273-8468-4612-a5cc-c0836b2e2a92', 'volume_size': 1, 'image_id': '0b46711d-1f83-4664-accf-e72dddab950a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0b46711d-1f83-4664-accf-e72dddab950a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c1ad7182695090595874820eff75ff69', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '1e1caadadc1d44dea2cdf9e3d781deb9', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ae3bf6e1dddf6468d0331764c0ddc45889d7ba8f5d20ba84346b14fd8cd9c2de86fe9259e2c21e3c03cc4df67ecbd998097e9eb2ec155d25f55f136a149aaded', 'id': '0b46711d-1f83-4664-accf-e72dddab950a', 'created_at': datetime.datetime(2026, 11, 5, 10, 6, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 6, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0b46711d-1f83-4664-accf-e72dddab950a/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b31e88-07a7-4b84-a3e1-f27b522df26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Created reservations ['827c781f-68d6-4551-b57a-53842c84f197', '2c257112-3e38-4e8c-b877-0bbb465989a4', '6ea999a0-3805-4e6f-8c1d-b0c1f6d7c8a4', '137aec9d-1b7b-4271-9c92-e838a6559c1b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Volume volume-d5555273-8468-4612-a5cc-c0836b2e2a92 (d5555273-8468-4612-a5cc-c0836b2e2a92): created successfully Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0b31e88-07a7-4b84-a3e1-f27b522df26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Flow 'volume_create_manager' (14ed55b4-f32a-462d-b960-3a8d5504634b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-23b78bd4-fceb-4a31-a962-d3eacc367477 tempest-VolumeImageDependencyTests-783651566 None] Created volume successfully. Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:40 devstack sudo[101490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:40 devstack sudo[101490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:40 devstack sudo[101490]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.328s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:06:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3757239c-4459-4c43-a354-8239fad0f620 tempest-VolumesGetTest-1169072910 None] Lock "cinder-a12cde65-feb4-4f34-812e-e0ddee6235b1-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Acquiring lock "cinder-d5555273-8468-4612-a5cc-c0836b2e2a92-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "cinder-d5555273-8468-4612-a5cc-c0836b2e2a92-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Acquiring lock "cinder-quobyte-d5555273-8468-4612-a5cc-c0836b2e2a92" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "cinder-quobyte-d5555273-8468-4612-a5cc-c0836b2e2a92" acquired by "delete_volume" :: waited 0.042s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3717285-2f51-405c-b5ec-6c0e1f84a660]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:42 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 Nov 05 11:06:42 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (1d5dcaa3-3fd3-4bca-9fc3-7049b0b6c125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4de5d28-b048-417b-b2f2-9b861bc228c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4de5d28-b048-417b-b2f2-9b861bc228c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-474473091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a90ffc-054f-4008-9df3-275d63ed725e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:42Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cec5e0-36cc-4ac7-8188-0590b0087be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (29cec5e0-36cc-4ac7-8188-0590b0087be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6869ac-d7e9-4afd-96d3-609883df1c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d6869ac-d7e9-4afd-96d3-609883df1c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a90ffc-054f-4008-9df3-275d63ed725e', 'volume_name': 'volume-c0a90ffc-054f-4008-9df3-275d63ed725e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7a0655-e954-4086-8eea-0796128c6685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed7a0655-e954-4086-8eea-0796128c6685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31f44e0-c336-46c4-bb71-dc0cac375485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Volume c0a90ffc-054f-4008-9df3-275d63ed725e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a90ffc-054f-4008-9df3-275d63ed725e', 'volume_size': 1} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:42 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92" returned: 0 in 0.658s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:42 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92 Nov 05 11:06:42 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:42 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d5555273-8468-4612-a5cc-c0836b2e2a92" returned: 0 in 0.470s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "cinder-quobyte-d5555273-8468-4612-a5cc-c0836b2e2a92" released by "delete_volume" :: held 1.246s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Created reservations ['8a7c9119-2031-4180-aff2-5579a1bdc7a7', '86f0b1a4-cfcc-4b4a-80e2-deea1b77acc7', '0c9b37ec-4b5e-4df3-9482-b101e4752913', '89d4301d-20e6-4a46-b19d-6058d447e8d0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:43 devstack sudo[101502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:43 devstack sudo[101502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:43 devstack sudo[101502]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.399s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Deleted volume successfully. Nov 05 11:06:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-634f857d-c101-493d-8697-f1e89f6e7a20 tempest-VolumeImageDependencyTests-783651566 None] Lock "cinder-d5555273-8468-4612-a5cc-c0836b2e2a92-delete_volume" released by "delete_volume" :: held 2.116s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:44 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img" returned: 0 in 7.476s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b4c1fe-ef11-4fb2-8468-bcb02b4e640b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:44 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:44 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:45 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.553s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408, size 1024.00 MB, duration 7.48 sec, destination /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:45 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Converted 1024.00 MB image at 136.95 MB/s Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] 6eea9c3d-1803-4443-9b3b-63ff4a1db5c4 was raw, converting to qcow2 {{(pid=87369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be3a12b-a8b5-4abe-8228-4534d91cfb04]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:45 devstack sudo[101511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img Nov 05 11:06:45 devstack sudo[101511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:45 devstack sudo[101511]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img" returned: 0 in 0.370s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:45 devstack sudo[101515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img Nov 05 11:06:45 devstack sudo[101515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:46 devstack sudo[101515]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img" returned: 1 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:46 devstack sudo[101520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay Nov 05 11:06:46 devstack sudo[101520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:46 devstack sudo[101520]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay" returned: 0 in 0.321s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Image conversion details: src /opt/stack/data/cinder/conversion/15e8b732-39e8-48cc-89bf-b2c45fe2b408.temp_image.6eea9c3d-1803-4443-9b3b-63ff4a1db5c4zdk0lrr4.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:46 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7204422-f6ae-4a07-a9b9-3dd1f1079838]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:46 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay Nov 05 11:06:46 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:46 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_e2eq9vay" returned: 0 in 0.351s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 12.156s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Uploaded volume to glance image-id: 6eea9c3d-1803-4443-9b3b-63ff4a1db5c4. {{(pid=87369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.598s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5fcf26f-5148-4ae6-a06c-77136c0ad178]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-999e7c7d-d63c-4cad-af92-7eaeb53edb28 tempest-VolumesActionsTest-1655116761 None] Copy volume to image completed successfully. Nov 05 11:06:48 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:06:48 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:48 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.442s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd01a61f-9721-4f36-8379-e37aa5b61a24]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:49 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:06:49 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:49 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.444s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc /opt/stack/data/cinder/conversion/8af027e4-7a4d-48d0-9c3a-e6b922afd8cc.temp_image.0348e46d-d7fc-4a4c-857a-b2e4e94e8dffmty8lwbm.img {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:49 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc /opt/stack/data/cinder/conversion/8af027e4-7a4d-48d0-9c3a-e6b922afd8cc.temp_image.0348e46d-d7fc-4a4c-857a-b2e4e94e8dffmty8lwbm.img Nov 05 11:06:49 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "cinder-quobyte-15e8b732-39e8-48cc-89bf-b2c45fe2b408" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-quobyte-15e8b732-39e8-48cc-89bf-b2c45fe2b408" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b710685f-2eef-4793-8215-49deac49a0e0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:49 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:49 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:50 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:50 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:50 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.898s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:50 devstack sudo[101564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408 Nov 05 11:06:50 devstack sudo[101564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:50 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:06:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:06:51 devstack sudo[101564]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15e8b732-39e8-48cc-89bf-b2c45fe2b408" returned: 0 in 0.526s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-quobyte-15e8b732-39e8-48cc-89bf-b2c45fe2b408" released by "delete_volume" :: held 1.504s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Created reservations ['4a31d5e3-e47e-442f-9c80-86db1b43d206', 'e2381d9b-a4cc-4b1a-bca7-8ad5f8133276', '8285e04e-4b62-46ef-9961-d1a3f001d9f7', 'f51a2b9a-7b7c-43ba-9a6c-c2c73540f77f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:06:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:51 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:06:51 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:52 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.635s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:52 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:06:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Deleted volume successfully. Nov 05 11:06:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-43d41886-ce1a-461f-8ca0-3a08697d21f9 tempest-VolumesActionsTest-1655116761 None] Lock "cinder-15e8b732-39e8-48cc-89bf-b2c45fe2b408-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:06:57 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc /opt/stack/data/cinder/conversion/8af027e4-7a4d-48d0-9c3a-e6b922afd8cc.temp_image.0348e46d-d7fc-4a4c-857a-b2e4e94e8dffmty8lwbm.img" returned: 0 in 8.045s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e450ef-d094-4e3a-a0fa-4b2f6a230e55]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:06:57 devstack sudo[101572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:06:57 devstack sudo[101572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (369f38d8-7fc6-426b-9f3a-04b688f39dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc6fd6d-a95d-46ad-acaf-40a2551f22e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc6fd6d-a95d-46ad-acaf-40a2551f22e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103898484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8708ca5-e0ef-48bd-a454-21909c098d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:57Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b452e24a-4097-4a0b-a815-3a5650e13d5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b452e24a-4097-4a0b-a815-3a5650e13d5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a62177-ea4c-481d-88d0-a04cb5690470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13a62177-ea4c-481d-88d0-a04cb5690470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8708ca5-e0ef-48bd-a454-21909c098d92', 'volume_name': 'volume-f8708ca5-e0ef-48bd-a454-21909c098d92', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627ba036-c772-4fcd-adef-b1ae2aa5a415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (627ba036-c772-4fcd-adef-b1ae2aa5a415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940514c2-7aca-4c2c-8027-6a638edf9de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:06:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Volume f8708ca5-e0ef-48bd-a454-21909c098d92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8708ca5-e0ef-48bd-a454-21909c098d92', 'volume_size': 1} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:06:57 devstack sudo[101572]: pam_unix(sudo:session): session closed for user root Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.537s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:06:57 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc, size 1024.00 MB, duration 8.05 sec, destination /opt/stack/data/cinder/conversion/8af027e4-7a4d-48d0-9c3a-e6b922afd8cc.temp_image.0348e46d-d7fc-4a4c-857a-b2e4e94e8dffmty8lwbm.img {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:06:57 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Converted 1024.00 MB image at 127.24 MB/s Nov 05 11:06:58 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] 0348e46d-d7fc-4a4c-857a-b2e4e94e8dff was raw, no need to convert to raw {{(pid=87369) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Flow 'volume_create_manager' (476e6149-a6d0-4bd6-b81a-1e19a4e729e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91360e5-13e9-4b99-8194-2353783a761d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e91360e5-13e9-4b99-8194-2353783a761d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-641662552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b696cbfa-847a-454a-914d-d5e7a2d53b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7acbbdaffa4df7a3d071b027fa59a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:03Z,use_quota=True,user_id='6ef4695885a54ac194acc1cc0f83bede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a743ea-3343-4aef-8d57-4063d8ec6d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3a743ea-3343-4aef-8d57-4063d8ec6d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff55d61-3d7c-419e-91c1-b9fc931b021d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ff55d61-3d7c-419e-91c1-b9fc931b021d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'volume_name': 'volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fa4275-0570-41d6-b19b-e7232471f7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1fa4275-0570-41d6-b19b-e7232471f7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729fcf77-aa4e-420c-8da1-c1f54c2810d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:02 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Volume b696cbfa-847a-454a-914d-d5e7a2d53b2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'volume_size': 1} Nov 05 11:07:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:12 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=34,cinder:UPDATE=43,cinder:INSERT=12,cinder:DELETE=5 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:07:12 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=35,cinder:UPDATE=44,cinder:INSERT=15,cinder:DELETE=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.561s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Uploaded volume to glance image-id: 0348e46d-d7fc-4a4c-857a-b2e4e94e8dff. {{(pid=87369) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 35.544s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-474473091',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a90ffc-054f-4008-9df3-275d63ed725e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:42Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Creating volume c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:18 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:18 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e 1073741824 Nov 05 11:07:18 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3606fe77-c1a1-4b8c-aebc-d9dc6e0eef7c tempest-TestImageHashVerification-1261122766 None] Copy volume to image completed successfully. Nov 05 11:07:18 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e 1073741824" returned: 0 in 0.415s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:18 devstack sudo[101592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:18 devstack sudo[101592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:18 devstack sudo[101592]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.253s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.712s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.097s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2103898484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8708ca5-e0ef-48bd-a454-21909c098d92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:06:57Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Creating volume f8708ca5-e0ef-48bd-a454-21909c098d92 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:18 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31f44e0-c336-46c4-bb71-dc0cac375485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a90ffc-054f-4008-9df3-275d63ed725e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:18 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 1073741824 Nov 05 11:07:18 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945d5530-7f2c-42c6-af04-7927a4ca9e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Volume volume-c0a90ffc-054f-4008-9df3-275d63ed725e (c0a90ffc-054f-4008-9df3-275d63ed725e): created successfully Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (945d5530-7f2c-42c6-af04-7927a4ca9e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (1d5dcaa3-3fd3-4bca-9fc3-7049b0b6c125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-602ca6dd-8ed8-4540-a0cd-9e8b5a88646f tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:07:19 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 1073741824" returned: 0 in 0.535s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:19 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 Nov 05 11:07:19 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Acquiring lock "cinder-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "cinder-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Acquiring lock "cinder-quobyte-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "cinder-quobyte-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4069f5bd-cc66-4d1a-a1b9-f8bd9d696466]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:19 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92" returned: 0 in 0.329s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.814s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-641662552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b696cbfa-847a-454a-914d-d5e7a2d53b2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7acbbdaffa4df7a3d071b027fa59a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:03Z,use_quota=True,user_id='6ef4695885a54ac194acc1cc0f83bede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Creating volume b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:19 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:19 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:07:19 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:19 devstack sudo[101605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b 1073741824 Nov 05 11:07:19 devstack sudo[101605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (940514c2-7aca-4c2c-8027-6a638edf9de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8708ca5-e0ef-48bd-a454-21909c098d92', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e7ccdf-0305-44c1-a343-677ed4bc2025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Volume volume-f8708ca5-e0ef-48bd-a454-21909c098d92 (f8708ca5-e0ef-48bd-a454-21909c098d92): created successfully Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e7ccdf-0305-44c1-a343-677ed4bc2025) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (369f38d8-7fc6-426b-9f3a-04b688f39dbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1621f352-21dc-4d66-80e3-fae2df324e25 tempest-ProjectReaderTests-410844775 None] Created volume successfully. Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (ea86ebf0-f992-4e8a-9d7f-445fe007de93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa467c4a-bd64-46f0-9122-bb7c5cbd61c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aa467c4a-bd64-46f0-9122-bb7c5cbd61c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-894485275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0f7afd5-27ae-48a2-8286-8d91c7d64fdf,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=c0a90ffc-054f-4008-9df3-275d63ed725e,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:20Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3012a184-f4bb-4f7c-8bc4-d140d97aef55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3012a184-f4bb-4f7c-8bc4-d140d97aef55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76147ed3-3649-4e26-a334-6124fdf3e72b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76147ed3-3649-4e26-a334-6124fdf3e72b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b0f7afd5-27ae-48a2-8286-8d91c7d64fdf', 'volume_name': 'volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf', 'volume_size': 1, 'source_volid': 'c0a90ffc-054f-4008-9df3-275d63ed725e', 'source_volstatus': 'available'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9135cab0-a7a6-43aa-a3ff-76a89a02fde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9135cab0-a7a6-43aa-a3ff-76a89a02fde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f683b8e-b7ef-421e-8344-e96f45ecfd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Volume b0f7afd5-27ae-48a2-8286-8d91c7d64fdf: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf', 'volume_size': 1, 'source_volid': 'c0a90ffc-054f-4008-9df3-275d63ed725e', 'source_volstatus': 'available'} Nov 05 11:07:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:20 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.484s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack sudo[101614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc Nov 05 11:07:20 devstack sudo[101614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-f8708ca5-e0ef-48bd-a454-21909c098d92-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:20 devstack sudo[101605]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b 1073741824" returned: 0 in 0.600s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "cinder-f8708ca5-e0ef-48bd-a454-21909c098d92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-quobyte-f8708ca5-e0ef-48bd-a454-21909c098d92" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack sudo[101614]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-f8708ca5-e0ef-48bd-a454-21909c098d92" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:20 devstack sudo[101617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:20 devstack sudo[101617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "cinder-quobyte-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc" released by "delete_volume" :: held 0.856s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a8e22bd-41e6-447e-9b74-db50368056f3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Created reservations ['546058f2-415c-4146-93b6-dd76f6d3d516', '03d1bada-d772-47ec-9221-fb114bdea254', '4ebc28c9-954a-4b3e-9cd0-8bcd833883b9', '0d2c9653-ee7a-42fa-b097-72b8744e9f30'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:20 devstack sudo[101619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 Nov 05 11:07:20 devstack sudo[101619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:20 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack sudo[101617]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.975s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.655s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:20 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Cloning volume c0a90ffc-054f-4008-9df3-275d63ed725e to volume b0f7afd5-27ae-48a2-8286-8d91c7d64fdf Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (729fcf77-aa4e-420c-8da1-c1f54c2810d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad292c-1ba5-4f0d-a4d4-affb809272ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:20 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Volume volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b (b696cbfa-847a-454a-914d-d5e7a2d53b2b): created successfully Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88ad292c-1ba5-4f0d-a4d4-affb809272ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Flow 'volume_create_manager' (476e6149-a6d0-4bd6-b81a-1e19a4e729e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Creating offline snapshot 2d35c930-2156-4f48-81bb-79aa42086757 of volume c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:07:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2596a4a3-7ba4-4130-9e40-68480c8904d5 tempest-VolumesCloneTest-388499839 None] Created volume successfully. Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30a29e25-ab83-4e91-9818-8b2f5b56d43a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack sudo[101619]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92" returned: 0 in 0.505s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.380s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:20 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Deleted volume successfully. Nov 05 11:07:20 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:20 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack sudo[101629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92 Nov 05 11:07:20 devstack sudo[101629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:20 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97f895f7-9aae-4589-a84e-2fed6f0a3bfb tempest-TestImageHashVerification-1261122766 None] Lock "cinder-8af027e4-7a4d-48d0-9c3a-e6b922afd8cc-delete_volume" released by "delete_volume" :: held 1.522s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:21 devstack sudo[101629]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f8708ca5-e0ef-48bd-a454-21909c098d92" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-f8708ca5-e0ef-48bd-a454-21909c098d92" released by "delete_volume" :: held 0.914s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:21 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.489s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:21 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 1G Nov 05 11:07:21 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Created reservations ['6a4e0dca-61c6-4525-af94-296e44040d33', 'b9949596-b7f2-4490-a580-34784dd763ee', 'c8d65699-cedf-4952-90e1-942b5c0dff4e', 'c2342aa2-1589-47f4-bd48-dba4265076c5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:21 devstack sudo[101638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:21 devstack sudo[101638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Flow 'volume_create_manager' (ea087c9d-0bb4-4451-8448-6291cc521c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8dd764-d94c-4b47-a29a-537fb21612b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7b8dd764-d94c-4b47-a29a-537fb21612b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1210918018',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8d25cc0-d48d-49da-bf23-a7918096a1c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f7acbbdaffa4df7a3d071b027fa59a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:22Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=b696cbfa-847a-454a-914d-d5e7a2d53b2b,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:22Z,use_quota=True,user_id='6ef4695885a54ac194acc1cc0f83bede',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bfbd1-a385-4909-a608-59539c2aaf47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (837bfbd1-a385-4909-a608-59539c2aaf47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031f65d-4835-420d-87ce-42f331478138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:21 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7031f65d-4835-420d-87ce-42f331478138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'd8d25cc0-d48d-49da-bf23-a7918096a1c7', 'volume_name': 'volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7', 'volume_size': 2, 'source_volid': 'b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'source_volstatus': 'available'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1996c-4dc4-46c7-be85-f338cfb15b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:21 devstack sudo[101638]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17f1996c-4dc4-46c7-be85-f338cfb15b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36974189-7a49-43dc-b88d-f30d4d1033f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:21 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Volume d8d25cc0-d48d-49da-bf23-a7918096a1c7: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7', 'volume_size': 2, 'source_volid': 'b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'source_volstatus': 'available'} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.404s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 1G" returned: 0 in 0.638s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a90ffc-054f-4008-9df3-275d63ed725e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Deleted volume successfully. Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:21 devstack sudo[101646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a90ffc-054f-4008-9df3-275d63ed725e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:21 devstack sudo[101646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d740159c-4ea9-4573-82c0-a63c69cbdfa4 tempest-ProjectReaderTests-410844775 None] Lock "cinder-f8708ca5-e0ef-48bd-a454-21909c098d92-delete_volume" released by "delete_volume" :: held 1.710s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:22 devstack sudo[101646]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c0a90ffc-054f-4008-9df3-275d63ed725e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:22 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 is being set with open permissions: ugo+rw Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:22 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:22 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:22 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:22 devstack sudo[101656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info Nov 05 11:07:22 devstack sudo[101656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:22 devstack sudo[101656]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info" returned: 0 in 0.366s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:22 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info is being set with open permissions: ugo+rw Nov 05 11:07:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:22 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info Nov 05 11:07:22 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (d8140d77-c9fc-402b-802f-d544212db14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fef7ba-dc3d-4b36-956d-78feed0cc4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fef7ba-dc3d-4b36-956d-78feed0cc4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289585184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0198e2de-762c-4ef2-9a98-d22c1adcbe49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:23Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979fed85-3e2a-4066-942b-a8ddb35443ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (979fed85-3e2a-4066-942b-a8ddb35443ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6c5562-af07-4b03-99b5-e4de034807a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c6c5562-af07-4b03-99b5-e4de034807a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0198e2de-762c-4ef2-9a98-d22c1adcbe49', 'volume_name': 'volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:23 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480cb596-16ec-435a-aef8-6d5c1f320ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (480cb596-16ec-435a-aef8-6d5c1f320ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e673b862-7a2f-4e28-8c29-cf418cba6e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Volume 0198e2de-762c-4ef2-9a98-d22c1adcbe49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49', 'volume_size': 1} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.info" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] snapshot: 2d35c930-2156-4f48-81bb-79aa42086757, volume: b0f7afd5-27ae-48a2-8286-8d91c7d64fdf, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[772464cd-f09b-40fc-bd69-a2f295c4e987]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:23 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:23 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:23 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.372s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a90ffc-054f-4008-9df3-275d63ed725e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd855b8-6b66-4f7b-ad47-5ef8b2f8b0c7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:23 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:23 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:24 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.408s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:07:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:07:24 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:07:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:24 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf Nov 05 11:07:24 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:31 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" returned: 0 in 7.335s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:07:31 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Converted 1024.00 MB image at 139.59 MB/s Nov 05 11:07:31 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf is being set with open permissions: ugo+rw Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:31 devstack sudo[101725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf Nov 05 11:07:31 devstack sudo[101725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:31 devstack sudo[101725]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" returned: 0 in 0.271s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" released by "_copy_volume_from_snapshot" :: held 8.475s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-2d35c930-2156-4f48-81bb-79aa42086757" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-2d35c930-2156-4f48-81bb-79aa42086757" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Deleting offline snapshot 2d35c930-2156-4f48-81bb-79aa42086757 of volume c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] snapshot_file for this snap is: volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[93bbdb78-6f44-41db-a9f8-24b3e0c6ded9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:31 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:31 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:32 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.370s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c0a90ffc-054f-4008-9df3-275d63ed725e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b56d69f-7510-4e72-bc1b-47ce19f50da4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:32 devstack sudo[101733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:32 devstack sudo[101733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:32 devstack sudo[101733]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.607s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:32 devstack sudo[101739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:32 devstack sudo[101739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=20,cinder:INSERT=5,cinder:UPDATE=29,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:07:33 devstack sudo[101739]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:33 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757 Nov 05 11:07:33 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:33 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e.2d35c930-2156-4f48-81bb-79aa42086757" returned: 0 in 0.270s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-2d35c930-2156-4f48-81bb-79aa42086757" released by "_delete_snapshot" :: held 1.773s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 12.967s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 11.655s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:33 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Cloning volume b696cbfa-847a-454a-914d-d5e7a2d53b2b to volume d8d25cc0-d48d-49da-bf23-a7918096a1c7 Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2f683b8e-b7ef-421e-8344-e96f45ecfd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf', 'volume_size': 1, 'source_volid': 'c0a90ffc-054f-4008-9df3-275d63ed725e', 'source_volstatus': 'available'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4565c23-772f-460d-b8a2-790f2904ce70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Creating offline snapshot 3743a564-7443-4717-9eee-6b947644ea35 of volume b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:07:33 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Volume volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf (b0f7afd5-27ae-48a2-8286-8d91c7d64fdf): created successfully Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4565c23-772f-460d-b8a2-790f2904ce70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (ea86ebf0-f992-4e8a-9d7f-445fe007de93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d31b41a9-f040-4631-904e-b7f8f98916c1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-01df3282-091d-478f-9ed3-72b59f1f9c93 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:07:33 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:33 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:34 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.447s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:34 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 1G Nov 05 11:07:34 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:34 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 1G" returned: 0 in 0.543s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:34 devstack sudo[101760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:34 devstack sudo[101760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:35 devstack sudo[101760]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:35 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 is being set with open permissions: ugo+rw Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:35 devstack sudo[101766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:35 devstack sudo[101766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (12836bb5-2ed3-496b-916c-1d2c963f23e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef7aa87-0c28-4cbb-b833-dbc8a3983169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ef7aa87-0c28-4cbb-b833-dbc8a3983169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-880900642',display_name='tempest-VolumesGetTest-Volume-1836966263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3151b7-90c0-493c-bd8f-436e280e51fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:35Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfd2179-f45b-4160-bdf3-8af52c517725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcfd2179-f45b-4160-bdf3-8af52c517725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f0468-d9bc-41a7-b36b-0eb231428c2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805f0468-d9bc-41a7-b36b-0eb231428c2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb3151b7-90c0-493c-bd8f-436e280e51fa', 'volume_name': 'volume-fb3151b7-90c0-493c-bd8f-436e280e51fa', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f940d1-950d-4df6-b5d7-3c442458181a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f940d1-950d-4df6-b5d7-3c442458181a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf01301-2cca-4193-8093-556940d8eb75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Volume fb3151b7-90c0-493c-bd8f-436e280e51fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb3151b7-90c0-493c-bd8f-436e280e51fa', 'volume_size': 1} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:35 devstack sudo[101766]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.360s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:35 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info Nov 05 11:07:35 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:35 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info" returned: 0 in 0.292s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:35 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info is being set with open permissions: ugo+rw Nov 05 11:07:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:35 devstack sudo[101772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info Nov 05 11:07:35 devstack sudo[101772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:36 devstack sudo[101772]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.info" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] snapshot: 3743a564-7443-4717-9eee-6b947644ea35, volume: d8d25cc0-d48d-49da-bf23-a7918096a1c7, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d93d88-f185-4f29-abb8-11299cd46182]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:36 devstack sudo[101775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:36 devstack sudo[101775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:36 devstack sudo[101775]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.371s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ecca81-d4d2-4145-ac78-1a5099d55b8d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:36 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:36 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:36 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.390s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:07:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:37 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 Nov 05 11:07:37 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Flow 'volume_create_manager' (8f9d4d90-4fde-447c-b29d-58b7cb084ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf653dd-0e62-48fc-9d4c-df967cc09753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bf653dd-0e62-48fc-9d4c-df967cc09753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684744550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbd7145-f843-4460-8d76-1d4cde923e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f851edb8f5b94e7b8ef99c3caaf746a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:39Z,use_quota=True,user_id='83a9298ed039445e974f61d99b5c95f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167a196f-0970-4ddf-8894-f87ea8cb497c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (167a196f-0970-4ddf-8894-f87ea8cb497c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8394700-8281-420a-aacc-8188af36e0d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8394700-8281-420a-aacc-8188af36e0d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bbd7145-f843-4460-8d76-1d4cde923e66', 'volume_name': 'volume-9bbd7145-f843-4460-8d76-1d4cde923e66', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10645f92-09d8-483f-82b9-7fa4a5ae2fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10645f92-09d8-483f-82b9-7fa4a5ae2fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98657ad0-cff0-496c-8f29-19d640f90ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:38 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Volume 9bbd7145-f843-4460-8d76-1d4cde923e66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bbd7145-f843-4460-8d76-1d4cde923e66', 'volume_size': 1} Nov 05 11:07:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:43 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7" returned: 0 in 6.343s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b, size 1024.00 MB, duration 6.34 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:07:43 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Converted 1024.00 MB image at 161.41 MB/s Nov 05 11:07:43 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 is being set with open permissions: ugo+rw Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:43 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 Nov 05 11:07:43 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:43 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7" returned: 0 in 0.226s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" released by "_copy_volume_from_snapshot" :: held 7.414s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-quobyte-3743a564-7443-4717-9eee-6b947644ea35" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-3743a564-7443-4717-9eee-6b947644ea35" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Deleting offline snapshot 3743a564-7443-4717-9eee-6b947644ea35 of volume b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] snapshot_file for this snap is: volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a953a548-97f9-4c5f-a958-22dcefdda4a6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:43 devstack sudo[101803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:43 devstack sudo[101803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:43 devstack sudo[101803]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.379s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d17d5a-e5b2-4a20-978a-1e29bd611761]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:44 devstack sudo[101809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:44 devstack sudo[101809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:44 devstack sudo[101809]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:44 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:44 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:44 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.314s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:44 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35 Nov 05 11:07:44 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:45 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b.3743a564-7443-4717-9eee-6b947644ea35" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-3743a564-7443-4717-9eee-6b947644ea35" released by "_delete_snapshot" :: held 1.562s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.569s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 21.961s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-289585184',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0198e2de-762c-4ef2-9a98-d22c1adcbe49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:23Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Creating volume 0198e2de-762c-4ef2-9a98-d22c1adcbe49 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:45 devstack sudo[101823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 1073741824 Nov 05 11:07:45 devstack sudo[101823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36974189-7a49-43dc-b88d-f30d4d1033f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7', 'volume_size': 2, 'source_volid': 'b696cbfa-847a-454a-914d-d5e7a2d53b2b', 'source_volstatus': 'available'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d04aad-e5cc-4544-ac31-2fa6ee14b0fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Volume volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 (d8d25cc0-d48d-49da-bf23-a7918096a1c7): created successfully Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60d04aad-e5cc-4544-ac31-2fa6ee14b0fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Flow 'volume_create_manager' (ea087c9d-0bb4-4451-8448-6291cc521c14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4c9b6c31-ea89-498c-a1a8-a2bcc3ce2f27 tempest-VolumesCloneTest-388499839 None] Created volume successfully. Nov 05 11:07:45 devstack sudo[101823]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 1073741824" returned: 0 in 0.404s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:45 devstack sudo[101829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 Nov 05 11:07:45 devstack sudo[101829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:45 devstack sudo[101829]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49" returned: 0 in 0.269s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] <== create_volume: return (713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.715s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.563s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:35Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-880900642',display_name='tempest-VolumesGetTest-Volume-1836966263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb3151b7-90c0-493c-bd8f-436e280e51fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:35Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Creating volume fb3151b7-90c0-493c-bd8f-436e280e51fa {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e673b862-7a2f-4e28-8c29-cf418cba6e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:45 devstack sudo[101832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa 1073741824 Nov 05 11:07:45 devstack sudo[101832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0598d492-a535-49a6-af40-a804e8f6ba1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Volume volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 (0198e2de-762c-4ef2-9a98-d22c1adcbe49): created successfully Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0598d492-a535-49a6-af40-a804e8f6ba1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (d8140d77-c9fc-402b-802f-d544212db14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a7d1a8c6-8b54-45f7-adc1-68bed1e00f75 tempest-ProjectReaderTests-410844775 None] Created volume successfully. Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-d8d25cc0-d48d-49da-bf23-a7918096a1c7-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "cinder-d8d25cc0-d48d-49da-bf23-a7918096a1c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-0198e2de-762c-4ef2-9a98-d22c1adcbe49-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86c8c42-6d2a-4465-b5a8-f1537baf6541]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "cinder-0198e2de-762c-4ef2-9a98-d22c1adcbe49-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-quobyte-0198e2de-762c-4ef2-9a98-d22c1adcbe49" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-0198e2de-762c-4ef2-9a98-d22c1adcbe49" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[46254ce1-ee6e-42fd-8728-deec64d28ea8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 Nov 05 11:07:46 devstack sudo[101832]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:46 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa 1073741824" returned: 0 in 0.567s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa Nov 05 11:07:46 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:46 devstack sudo[101839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 Nov 05 11:07:46 devstack sudo[101839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:46 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7" returned: 0 in 0.395s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7 Nov 05 11:07:46 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:46 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa" returned: 0 in 0.264s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.854s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-684744550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bbd7145-f843-4460-8d76-1d4cde923e66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f851edb8f5b94e7b8ef99c3caaf746a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:39Z,use_quota=True,user_id='83a9298ed039445e974f61d99b5c95f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Creating volume 9bbd7145-f843-4460-8d76-1d4cde923e66 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:46 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acf01301-2cca-4193-8093-556940d8eb75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb3151b7-90c0-493c-bd8f-436e280e51fa', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:46 devstack sudo[101852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 1073741824 Nov 05 11:07:46 devstack sudo[101852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682c83a1-33e5-42d4-90e4-6989cc778b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Volume volume-fb3151b7-90c0-493c-bd8f-436e280e51fa (fb3151b7-90c0-493c-bd8f-436e280e51fa): created successfully Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (682c83a1-33e5-42d4-90e4-6989cc778b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (12836bb5-2ed3-496b-916c-1d2c963f23e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:46 devstack sudo[101839]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49" returned: 0 in 0.417s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-85d2716b-b6e3-499c-a3dd-07d3ec51d3b3 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:07:46 devstack sudo[101855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49 Nov 05 11:07:46 devstack sudo[101855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d8d25cc0-d48d-49da-bf23-a7918096a1c7" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-d8d25cc0-d48d-49da-bf23-a7918096a1c7" released by "delete_volume" :: held 0.737s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Created reservations ['a3353ca0-cf98-40b8-b662-68e6e3eb4dad', 'bc3986be-7f5f-4862-abf0-ae4c0c7ae303', '8b4ed246-b44d-47b7-aa2c-dff742a8d6b2', 'cbcd733c-ce42-4471-85f5-0aa25c5cf11b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:47 devstack sudo[101855]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0198e2de-762c-4ef2-9a98-d22c1adcbe49" returned: 0 in 0.297s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-0198e2de-762c-4ef2-9a98-d22c1adcbe49" released by "delete_volume" :: held 0.767s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:47 devstack sudo[101863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:47 devstack sudo[101863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Created reservations ['2c91e3db-5755-4603-a425-e6afac30ef84', '6abefafd-a1f7-4cc6-8e87-13b52bfcf068', 'd77a32a9-036a-4e0d-980b-bbd6c9f69882', '3c61b52a-51c0-442f-b4b7-6cfff5fc1e21'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-fb3151b7-90c0-493c-bd8f-436e280e51fa-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "cinder-fb3151b7-90c0-493c-bd8f-436e280e51fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:47 devstack sudo[101852]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 1073741824" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-fb3151b7-90c0-493c-bd8f-436e280e51fa" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:47 devstack sudo[101865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:47 devstack sudo[101865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-fb3151b7-90c0-493c-bd8f-436e280e51fa" acquired by "delete_volume" :: waited 0.052s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:47 devstack sudo[101868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 Nov 05 11:07:47 devstack sudo[101868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack sudo[101863]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.379s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Deleted volume successfully. Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b920d28e-a8f3-4aee-82d7-748e2483d053]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-b696cbfa-847a-454a-914d-d5e7a2d53b2b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06645668-d002-4f24-ba6e-439f4b9e9cdc tempest-VolumesCloneTest-388499839 None] Lock "cinder-d8d25cc0-d48d-49da-bf23-a7918096a1c7-delete_volume" released by "delete_volume" :: held 1.474s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "cinder-b696cbfa-847a-454a-914d-d5e7a2d53b2b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Acquiring lock "cinder-quobyte-b696cbfa-847a-454a-914d-d5e7a2d53b2b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-b696cbfa-847a-454a-914d-d5e7a2d53b2b" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:47 devstack sudo[101865]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.365s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Deleted volume successfully. Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a4a3a1-f4c6-4288-a824-a58a733d7ea9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:47 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa Nov 05 11:07:47 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5fca7511-fd0f-49d7-86e1-f3414f925b0d tempest-ProjectReaderTests-410844775 None] Lock "cinder-0198e2de-762c-4ef2-9a98-d22c1adcbe49-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:47 devstack sudo[101868]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:47 devstack sudo[101872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:47 devstack sudo[101872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66" returned: 0 in 0.466s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] <== create_volume: return (1192ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98657ad0-cff0-496c-8f29-19d640f90ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bbd7145-f843-4460-8d76-1d4cde923e66', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f00d6a-b3e6-4ab6-9fc4-4525f713f839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Volume volume-9bbd7145-f843-4460-8d76-1d4cde923e66 (9bbd7145-f843-4460-8d76-1d4cde923e66): created successfully Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5f00d6a-b3e6-4ab6-9fc4-4525f713f839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Flow 'volume_create_manager' (8f9d4d90-4fde-447c-b29d-58b7cb084ec7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ee026eb6-1882-44f2-b335-3af822a8e43e tempest-ProjectReaderTests-2145808498 None] Created volume successfully. Nov 05 11:07:48 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa" returned: 0 in 0.614s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:48 devstack sudo[101882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa Nov 05 11:07:48 devstack sudo[101882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (a425dd1b-1980-49d9-902a-904f3366b311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:48 devstack sudo[101872]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14111b1-f175-4b14-b790-252b3736c8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.529s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f14111b1-f175-4b14-b790-252b3736c8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259829030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9225f690-d20b-470f-8e21-90add5243a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:48Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c037b0-d831-431f-9886-3db12959f6cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack sudo[101887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15c037b0-d831-431f-9886-3db12959f6cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack sudo[101887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0a0ada-1e21-4701-8b30-6fdfdf01293e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a0a0ada-1e21-4701-8b30-6fdfdf01293e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9225f690-d20b-470f-8e21-90add5243a72', 'volume_name': 'volume-9225f690-d20b-470f-8e21-90add5243a72', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372015d0-ccdf-43ed-95d7-58af0671c45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (372015d0-ccdf-43ed-95d7-58af0671c45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14a11cf-c81c-42e8-869b-e3bd1b7d56a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Volume 9225f690-d20b-470f-8e21-90add5243a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9225f690-d20b-470f-8e21-90add5243a72', 'volume_size': 1} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1259829030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9225f690-d20b-470f-8e21-90add5243a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:48Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Creating volume 9225f690-d20b-470f-8e21-90add5243a72 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:48 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:48 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 1073741824 Nov 05 11:07:48 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:48 devstack sudo[101882]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fb3151b7-90c0-493c-bd8f-436e280e51fa" returned: 0 in 0.337s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-fb3151b7-90c0-493c-bd8f-436e280e51fa" released by "delete_volume" :: held 1.069s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Created reservations ['6bb81026-ab03-4baa-b211-7d39f9167543', '8b19b268-daa3-42c8-8f87-909902ccbb3d', '92c9c8e3-cdf4-4b1a-a8f4-bd94c475b263', '9f4dd361-3a3a-4c8e-b747-2603d575d64e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "cinder-9bbd7145-f843-4460-8d76-1d4cde923e66-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:48 devstack sudo[101887]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b696cbfa-847a-454a-914d-d5e7a2d53b2b" returned: 0 in 0.383s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-9bbd7145-f843-4460-8d76-1d4cde923e66-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "cinder-quobyte-b696cbfa-847a-454a-914d-d5e7a2d53b2b" released by "delete_volume" :: held 1.031s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "cinder-quobyte-9bbd7145-f843-4460-8d76-1d4cde923e66" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:48 devstack sudo[101896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:48 devstack sudo[101896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-quobyte-9bbd7145-f843-4460-8d76-1d4cde923e66" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fc6a6a-b6ef-458c-b6f2-ed02269eb85d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Created reservations ['06815bf6-087e-4dab-b14c-e31a2dd3ba18', 'd5ea14e5-74e6-4b02-b436-b32668349316', '02817dd5-7591-4dd3-86bb-27b22143f49d', 'f28741e2-fd2f-4cda-a662-a8d80fb62d46'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:49 devstack sudo[101899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 Nov 05 11:07:49 devstack sudo[101899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:49 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 1073741824" returned: 0 in 0.621s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:49 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:49 devstack sudo[101896]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f9e88891-542c-46ba-a4e8-d00b423c23af tempest-VolumesGetTest-1169072910 None] Lock "cinder-fb3151b7-90c0-493c-bd8f-436e280e51fa-delete_volume" released by "delete_volume" :: held 1.829s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:49 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 Nov 05 11:07:49 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:49 devstack sudo[101899]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66" returned: 0 in 0.425s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:49 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:49 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66 Nov 05 11:07:49 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Deleted volume successfully. Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-613bc23c-7448-40a0-9417-604437d4bf46 tempest-VolumesCloneTest-388499839 None] Lock "cinder-b696cbfa-847a-454a-914d-d5e7a2d53b2b-delete_volume" released by "delete_volume" :: held 1.746s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:49 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] <== create_volume: return (1005ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c14a11cf-c81c-42e8-869b-e3bd1b7d56a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9225f690-d20b-470f-8e21-90add5243a72', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ff18e-30cb-4bfb-9c41-b42481650685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:49 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Volume volume-9225f690-d20b-470f-8e21-90add5243a72 (9225f690-d20b-470f-8e21-90add5243a72): created successfully Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (581ff18e-30cb-4bfb-9c41-b42481650685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (a425dd1b-1980-49d9-902a-904f3366b311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9fef90cc-b059-4a1a-92e4-c9fc03d1ecfd tempest-ProjectReaderTests-410844775 None] Created volume successfully. Nov 05 11:07:49 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9bbd7145-f843-4460-8d76-1d4cde923e66" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-quobyte-9bbd7145-f843-4460-8d76-1d4cde923e66" released by "delete_volume" :: held 0.752s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Created reservations ['83372dfe-e770-4946-93d7-97fa08ee63ad', 'd73229af-8918-4650-b45a-a4bc67b9f50d', '73e2d5c6-c42d-4f2b-ae83-3ee962f9245d', '930b99ec-4db5-44a0-b6bf-17e6b85e79d3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "cinder-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e905c3fb-4447-4567-8f96-1d96a3efc8e2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:49 devstack sudo[101914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:49 devstack sudo[101914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:49 devstack sudo[101915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf Nov 05 11:07:50 devstack sudo[101915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:50 devstack sudo[101914]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.347s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Deleted volume successfully. Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6fdab3f5-22cd-45cc-ae8b-ffb6d8371b16 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-9bbd7145-f843-4460-8d76-1d4cde923e66-delete_volume" released by "delete_volume" :: held 1.471s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:50 devstack sudo[101921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:50 devstack sudo[101921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:50 devstack sudo[101915]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" returned: 0 in 0.572s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:50 devstack sudo[101924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf Nov 05 11:07:50 devstack sudo[101924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-9225f690-d20b-470f-8e21-90add5243a72-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "cinder-9225f690-d20b-470f-8e21-90add5243a72-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:50 devstack sudo[101921]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Flow 'volume_create_manager' (717360c3-38be-4c83-91c8-d87176c2c180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd112009-46b9-4330-96d6-e95a50094a5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-quobyte-9225f690-d20b-470f-8e21-90add5243a72" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd112009-46b9-4330-96d6-e95a50094a5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815711584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f851edb8f5b94e7b8ef99c3caaf746a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:50Z,use_quota=True,user_id='83a9298ed039445e974f61d99b5c95f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f14ba5-e5d2-4928-ae1f-a5393b406fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5f14ba5-e5d2-4928-ae1f-a5393b406fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f990378-39eb-4198-8868-1124d57710b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f990378-39eb-4198-8868-1124d57710b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe', 'volume_name': 'volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe36baa7-8cbb-4c81-92f6-be6859d3c36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe36baa7-8cbb-4c81-92f6-be6859d3c36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37beada7-9be6-4d21-b6d9-97064a06b1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Volume 00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe', 'volume_size': 1} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-815711584',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f851edb8f5b94e7b8ef99c3caaf746a1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:50Z,use_quota=True,user_id='83a9298ed039445e974f61d99b5c95f5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Creating volume 00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:50 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:50 devstack sudo[101924]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" returned: 0 in 0.329s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:50 devstack sudo[101928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe 1073741824 Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-9225f690-d20b-470f-8e21-90add5243a72" acquired by "delete_volume" :: waited 0.099s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:50 devstack sudo[101928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf" released by "delete_volume" :: held 0.995s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2671a143-7bd1-4711-ab9a-813cb1c0d55d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:50 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Created reservations ['ea86a0dc-d5f2-4a37-937d-30a1440c49bc', 'a3ae5fbb-ae2e-4752-9c7a-cf64df5b7e3a', '53249951-dab0-40ee-a72b-84a626d65eb2', 'c73c013e-baf7-4498-ae31-b01bca446a07'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:50 devstack sudo[101930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 Nov 05 11:07:50 devstack sudo[101930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:51 devstack sudo[101933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:51 devstack sudo[101933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:51 devstack sudo[101930]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72" returned: 0 in 0.467s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:51 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72 Nov 05 11:07:51 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:51 devstack sudo[101928]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe 1073741824" returned: 0 in 0.611s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:51 devstack sudo[101933]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.347s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3a6b8ea5-09c0-4942-af74-1ea84212bd1a tempest-VolumesGetTest-1169072910 None] Lock "cinder-b0f7afd5-27ae-48a2-8286-8d91c7d64fdf-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:51 devstack sudo[101944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe Nov 05 11:07:51 devstack sudo[101944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:51 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9225f690-d20b-470f-8e21-90add5243a72" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-9225f690-d20b-470f-8e21-90add5243a72" released by "delete_volume" :: held 0.846s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Created reservations ['ae1a2a77-fde2-499b-a4b2-3604f6fa47ec', '658410bc-0cfa-41ff-9cba-dcb73277f0d9', '35e94c06-5a74-4a48-8e33-7ef8cb86cfbb', 'b1fb76e6-6bc0-4615-ba51-32f990141cf0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:51 devstack sudo[101944]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37beada7-9be6-4d21-b6d9-97064a06b1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e15f1f-7d97-48c8-ba32-4c780ff9d825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Volume volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe (00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe): created successfully Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37e15f1f-7d97-48c8-ba32-4c780ff9d825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Flow 'volume_create_manager' (717360c3-38be-4c83-91c8-d87176c2c180) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ab725a28-d5b2-4769-aa9a-15e00f698b7a tempest-ProjectReaderTests-2145808498 None] Created volume successfully. Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:51 devstack sudo[101948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:51 devstack sudo[101948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-c0a90ffc-054f-4008-9df3-275d63ed725e-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "cinder-c0a90ffc-054f-4008-9df3-275d63ed725e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:52 devstack sudo[101948]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-c0a90ffc-054f-4008-9df3-275d63ed725e" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Deleted volume successfully. Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-c0a90ffc-054f-4008-9df3-275d63ed725e" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-89faa805-c03d-4576-8c58-5d1b33b58457 tempest-ProjectReaderTests-410844775 None] Lock "cinder-9225f690-d20b-470f-8e21-90add5243a72-delete_volume" released by "delete_volume" :: held 1.664s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[41717ac3-f9d4-4c05-908b-906ee32cef79]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:52 devstack sudo[101951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:52 devstack sudo[101951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:52 devstack sudo[101951]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.417s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:52 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e Nov 05 11:07:52 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "cinder-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "cinder-quobyte-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-quobyte-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d222a0f7-3a47-4d85-bf60-1c6030afeade]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:53 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe Nov 05 11:07:53 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:53 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c0a90ffc-054f-4008-9df3-275d63ed725e" returned: 0 in 0.407s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-c0a90ffc-054f-4008-9df3-275d63ed725e" released by "delete_volume" :: held 0.923s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Created reservations ['5c557845-ad24-4fbe-abe0-73f4b7ae81ce', '56adf41b-6e6b-4b45-b7c6-8f3c8b810bd9', '6e8b37fa-456c-458d-bc11-e8915f7d098e', '5224243e-d482-4de0-8233-2e3313f0bc8e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:53 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" returned: 0 in 0.559s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:53 devstack sudo[101964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:53 devstack sudo[101964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:53 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe Nov 05 11:07:53 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (cee95836-7d9f-45f4-b101-c0e93b63a22b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa73c0-ca85-4b24-a925-e68d52f91ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9fa73c0-ca85-4b24-a925-e68d52f91ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804887851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600148a1-7ee4-4705-a1c0-ac333f2ac3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:54Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce52f84e-afe5-4718-8c1e-267c5afc40cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce52f84e-afe5-4718-8c1e-267c5afc40cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed419512-081b-4b5d-8f2e-993bf87e9855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed419512-081b-4b5d-8f2e-993bf87e9855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '600148a1-7ee4-4705-a1c0-ac333f2ac3ae', 'volume_name': 'volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223df8fb-2cec-4399-ba3b-0ffba095ca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (223df8fb-2cec-4399-ba3b-0ffba095ca63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1704c1e-fe29-4b50-8ba7-5223802b933f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Volume 600148a1-7ee4-4705-a1c0-ac333f2ac3ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae', 'volume_size': 1} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-804887851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=600148a1-7ee4-4705-a1c0-ac333f2ac3ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f4db098d8a8c4023bb100971d3e8f9ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:54Z,use_quota=True,user_id='0a6bddfe36df444abd8631d53b059b7d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Creating volume 600148a1-7ee4-4705-a1c0-ac333f2ac3ae {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:53 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:53 devstack sudo[101970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae 1073741824 Nov 05 11:07:53 devstack sudo[101970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:53 devstack sudo[101964]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:53 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-quobyte-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe" released by "delete_volume" :: held 0.912s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4e0ca6e3-3e2d-40eb-b098-628cb84df498 tempest-VolumesGetTest-1169072910 None] Lock "cinder-c0a90ffc-054f-4008-9df3-275d63ed725e-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Created reservations ['4afb50a0-a4c0-45b5-bda2-98692f6dbaf6', 'db4936d5-109c-4944-aefa-eb2cc3dc1e71', '425184e7-bc24-4ed6-b03e-c92724fb1eda', '412b0140-bf03-45c6-ba0d-2752f5491861'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:54 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:54 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:54 devstack sudo[101970]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae 1073741824" returned: 0 in 0.576s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:54 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.282s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Deleted volume successfully. Nov 05 11:07:54 devstack sudo[101979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae Nov 05 11:07:54 devstack sudo[101979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-86d89053-e03f-48e7-bb65-dc9b57f9ced4 tempest-ProjectReaderTests-2145808498 None] Lock "cinder-00853d65-c2c0-4af8-b2e5-fc0ad9fac5fe-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:54 devstack sudo[101979]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" returned: 0 in 0.339s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1704c1e-fe29-4b50-8ba7-5223802b933f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968b414a-33b7-4db2-8daf-92bf0e87aabf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Volume volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae (600148a1-7ee4-4705-a1c0-ac333f2ac3ae): created successfully Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (968b414a-33b7-4db2-8daf-92bf0e87aabf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Flow 'volume_create_manager' (cee95836-7d9f-45f4-b101-c0e93b63a22b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3ef18b7f-78e2-448d-983c-e8d371c59178 tempest-ProjectReaderTests-410844775 None] Created volume successfully. Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Flow 'volume_create_manager' (38451d0e-f13b-41c5-90d0-20af34d50eae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5c985a-f7d6-443f-b8ae-d91a7b80f103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f5c985a-f7d6-443f-b8ae-d91a7b80f103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-591557233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda161f3-2d9a-4c3b-8a7c-200b75e1d173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53a88181b2d4e6fad9795107777df59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:55Z,use_quota=True,user_id='2073ee0eac5f4dbd9064748654b28178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed12c57a-5e88-4590-8608-5ed257ec7052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed12c57a-5e88-4590-8608-5ed257ec7052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df65db3-24f9-41af-8122-8acf3beaf508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3df65db3-24f9-41af-8122-8acf3beaf508) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fda161f3-2d9a-4c3b-8a7c-200b75e1d173', 'volume_name': 'volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4650e72-c3b2-4672-ab55-5ee20e1f9905) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4650e72-c3b2-4672-ab55-5ee20e1f9905) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5d7eeb-c9f1-4bca-969f-d746c9242985) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Volume fda161f3-2d9a-4c3b-8a7c-200b75e1d173: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173', 'volume_size': 1} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-591557233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fda161f3-2d9a-4c3b-8a7c-200b75e1d173,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a53a88181b2d4e6fad9795107777df59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:55Z,use_quota=True,user_id='2073ee0eac5f4dbd9064748654b28178',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Creating volume fda161f3-2d9a-4c3b-8a7c-200b75e1d173 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:55 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:07:55 devstack sudo[101982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 1073741824 Nov 05 11:07:55 devstack sudo[101982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (0e95822b-5001-4c6f-be77-b8466b6601c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f399ef-65ac-4116-a09c-34a6bb7683f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-600148a1-7ee4-4705-a1c0-ac333f2ac3ae-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99f399ef-65ac-4116-a09c-34a6bb7683f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1061223145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b49989d-dfb0-4cbc-a120-7a89c7b39442,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:56Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6589ba-d090-40c4-808b-154d19232f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d6589ba-d090-40c4-808b-154d19232f12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f02ebb-1d33-4ab5-9197-2a5dda2b77b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "cinder-600148a1-7ee4-4705-a1c0-ac333f2ac3ae-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Acquiring lock "cinder-quobyte-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98f5d4c-ab2e-42fc-9a23-0b2b401fc78c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:56 devstack sudo[101984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae Nov 05 11:07:56 devstack sudo[101984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1f02ebb-1d33-4ab5-9197-2a5dda2b77b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '5b49989d-dfb0-4cbc-a120-7a89c7b39442', 'volume_name': 'volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e5e041-effe-4850-b40a-847b15a992cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20e5e041-effe-4850-b40a-847b15a992cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7663d074-8a3c-4254-ba31-d112ec7f5f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:56 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Trying to clone 5b49989d-dfb0-4cbc-a120-7a89c7b39442 from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae at location (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:07:56 devstack sudo[101982]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 1073741824" returned: 0 in 0.647s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:56 devstack sudo[101984]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" returned: 0 in 0.524s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:56 devstack sudo[101994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 Nov 05 11:07:56 devstack sudo[101994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:56 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae Nov 05 11:07:56 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:07:56 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Image download 20.69 MB at 20.69 MB/s Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8312f2-5416-48ee-bdad-6465f7334321]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:56 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:56 devstack sudo[101994]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" returned: 0 in 0.464s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "cinder-quobyte-600148a1-7ee4-4705-a1c0-ac333f2ac3ae" released by "delete_volume" :: held 1.010s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef5d7eeb-c9f1-4bca-969f-d746c9242985) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:56 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD Nov 05 11:07:56 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec830e-7f7b-42f6-b206-af470ec60cfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:07:56 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Volume volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 (fda161f3-2d9a-4c3b-8a7c-200b75e1d173): created successfully Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cec830e-7f7b-42f6-b206-af470ec60cfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Flow 'volume_create_manager' (38451d0e-f13b-41c5-90d0-20af34d50eae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:07:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-18103d60-35d4-427a-89d1-270d77f555d9 tempest-VolumesNegativeTest-2088368667 None] Created volume successfully. Nov 05 11:07:56 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Created reservations ['9d148be0-999c-4aeb-b242-c6833749cf2d', '6d765f97-06b6-4ca8-861a-34bbc1596d42', '217a900e-384d-4cde-a2ef-792ca32b94a8', '19f6c347-5f22-4100-ae02-add3dd4a8534'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:57 devstack sudo[102003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:07:57 devstack sudo[102003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:57 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD" returned: 0 in 0.401s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae is fetched for user ded48abd2d394c25bc7277b8680c431b. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e27f66b-454e-40fe-bfdd-e8d283d08940]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:57 devstack sudo[102003]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:07:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Deleted volume successfully. Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-327c73a5-67ac-4159-8175-fe831e249c6a tempest-ProjectReaderTests-410844775 None] Lock "cinder-600148a1-7ee4-4705-a1c0-ac333f2ac3ae-delete_volume" released by "delete_volume" :: held 1.624s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:07:57 devstack sudo[102008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD Nov 05 11:07:57 devstack sudo[102008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:57 devstack sudo[102008]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD" returned: 0 in 0.399s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1061223145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b49989d-dfb0-4cbc-a120-7a89c7b39442,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:07:56Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Creating volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:07:57 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:07:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:57 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1073741824 Nov 05 11:07:57 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:58 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1073741824" returned: 0 in 0.578s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:58 devstack sudo[102021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 Nov 05 11:07:58 devstack sudo[102021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:58 devstack sudo[102021]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442" returned: 0 in 0.381s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Attempting download of d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f088b21b-6953-44fb-a460-55aa21376a0d]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:58 devstack sudo[102027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff Nov 05 11:07:58 devstack sudo[102027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:59 devstack sudo[102027]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff" returned: 0 in 0.462s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:59 devstack sudo[102031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff Nov 05 11:07:59 devstack sudo[102031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:07:59 devstack sudo[102031]: pam_unix(sudo:session): session closed for user root Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff" returned: 1 in 0.553s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_gg7qf7ff' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ce64b4-0a34-4936-8309-c7b0622a0b05]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:07:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:07:59 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD Nov 05 11:07:59 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:00 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD" returned: 0 in 0.544s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:00 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] d8cb4abc-43bb-420e-94aa-12ceb67e37ae was qcow2, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:08:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:00 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 Nov 05 11:08:00 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:03 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442" returned: 0 in 2.704s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d8cb4abc-43bb-420e-94aa-12ceb67e37ae_bqs52c34devstack@QuobyteHD, size 112.00 MB, duration 2.71 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:08:03 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Converted 112.00 MB image at 41.40 MB/s Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:03 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1G Nov 05 11:08:03 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:03 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 1G" returned: 0 in 0.403s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Downloaded image d8cb4abc-43bb-420e-94aa-12ceb67e37ae ((None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}])) to volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Temporary image d8cb4abc-43bb-420e-94aa-12ceb67e37ae for user ded48abd2d394c25bc7277b8680c431b is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Marking volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Copying metadata from image d8cb4abc-43bb-420e-94aa-12ceb67e37ae to 5b49989d-dfb0-4cbc-a120-7a89c7b39442. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Creating volume glance metadata for volume 5b49989d-dfb0-4cbc-a120-7a89c7b39442 backed by image d8cb4abc-43bb-420e-94aa-12ceb67e37ae with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7663d074-8a3c-4254-ba31-d112ec7f5f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442', 'volume_size': 1, 'image_id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '431ccae684ef45aea7ae8b4af7ae3374', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd8cb4abc-43bb-420e-94aa-12ceb67e37ae', 'created_at': datetime.datetime(2026, 11, 5, 9, 46, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 9, 46, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d8cb4abc-43bb-420e-94aa-12ceb67e37ae/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cec7e6-c94a-481b-ba28-b5775164e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:03 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Volume volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 (5b49989d-dfb0-4cbc-a120-7a89c7b39442): created successfully Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06cec7e6-c94a-481b-ba28-b5775164e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (0e95822b-5001-4c6f-be77-b8466b6601c1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-69db2c5d-d3ae-43dc-8908-843f4891e463 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (0b1a2171-0146-40d2-822b-7460887d5c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0fff8-55d8-4b28-950a-de158a1d2196) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89e0fff8-55d8-4b28-950a-de158a1d2196) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050792250',display_name='tempest-VolumesGetTest-Volume-1596616559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba7256-c528-4eb0-974e-fa2934383570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:05Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f903324-5bb1-4bee-bdec-607ad3d777d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f903324-5bb1-4bee-bdec-607ad3d777d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf44f746-4771-418c-9cd9-d703072bf36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf44f746-4771-418c-9cd9-d703072bf36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aba7256-c528-4eb0-974e-fa2934383570', 'volume_name': 'volume-4aba7256-c528-4eb0-974e-fa2934383570', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e28540-05f6-4287-be4b-e92e69ef57b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88e28540-05f6-4287-be4b-e92e69ef57b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a644e551-1948-4d84-a87a-90ef4ae1de0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:05 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Volume 4aba7256-c528-4eb0-974e-fa2934383570: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aba7256-c528-4eb0-974e-fa2934383570', 'volume_size': 1} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-2050792250',display_name='tempest-VolumesGetTest-Volume-1596616559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aba7256-c528-4eb0-974e-fa2934383570,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63d1e216e4ab445d94179cc8c111b8fc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:05Z,use_quota=True,user_id='ded48abd2d394c25bc7277b8680c431b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Creating volume 4aba7256-c528-4eb0-974e-fa2934383570 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:05 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:08:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:05 devstack sudo[102074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 1073741824 Nov 05 11:08:05 devstack sudo[102074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:06 devstack sudo[102074]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 1073741824" returned: 0 in 0.994s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:06 devstack sudo[102146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 Nov 05 11:08:06 devstack sudo[102146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:06 devstack sudo[102146]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570" returned: 0 in 0.383s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.441s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a644e551-1948-4d84-a87a-90ef4ae1de0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aba7256-c528-4eb0-974e-fa2934383570', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbbc0e7-93fb-4e51-8769-172ca15f118d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:06 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Volume volume-4aba7256-c528-4eb0-974e-fa2934383570 (4aba7256-c528-4eb0-974e-fa2934383570): created successfully Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2cbbc0e7-93fb-4e51-8769-172ca15f118d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Flow 'volume_create_manager' (0b1a2171-0146-40d2-822b-7460887d5c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-52c10187-6249-4b40-9021-dbdb3aaa2572 tempest-VolumesGetTest-1169072910 None] Created volume successfully. Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-4aba7256-c528-4eb0-974e-fa2934383570-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "cinder-4aba7256-c528-4eb0-974e-fa2934383570-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-4aba7256-c528-4eb0-974e-fa2934383570" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-4aba7256-c528-4eb0-974e-fa2934383570" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d5f73f8-2411-4c4d-958d-dcdf73de0854]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:07 devstack sudo[102151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 Nov 05 11:08:07 devstack sudo[102151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:07 devstack sudo[102151]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570" returned: 0 in 0.483s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:08 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570 Nov 05 11:08:08 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:08 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4aba7256-c528-4eb0-974e-fa2934383570" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-4aba7256-c528-4eb0-974e-fa2934383570" released by "delete_volume" :: held 0.830s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Created reservations ['3ac3ca8c-820a-4441-8048-4b12a5402721', '469422bf-12be-4d60-be59-cdd3944c4a25', '8db72f9f-d7ae-4e4d-8e70-2461d88043ee', '0f533ba8-d75a-40a1-bb76-45b97f1c57c1'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:08 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:08 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-5b49989d-dfb0-4cbc-a120-7a89c7b39442-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "cinder-5b49989d-dfb0-4cbc-a120-7a89c7b39442-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Acquiring lock "cinder-quobyte-5b49989d-dfb0-4cbc-a120-7a89c7b39442" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-5b49989d-dfb0-4cbc-a120-7a89c7b39442" acquired by "delete_volume" :: waited 0.066s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[89248b63-40f8-409a-89ca-31b50e2352ba]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:09 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 Nov 05 11:08:09 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:09 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.860s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4ed9d7a7-5632-4605-a062-811ee22dde96 tempest-VolumesGetTest-1169072910 None] Lock "cinder-4aba7256-c528-4eb0-974e-fa2934383570-delete_volume" released by "delete_volume" :: held 2.140s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:09 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442" returned: 0 in 0.512s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:09 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442 Nov 05 11:08:09 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:10 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5b49989d-dfb0-4cbc-a120-7a89c7b39442" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "cinder-quobyte-5b49989d-dfb0-4cbc-a120-7a89c7b39442" released by "delete_volume" :: held 0.995s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Created reservations ['98e29801-d704-4ef7-9038-9d14275336d8', 'de889c53-f966-4b46-9890-bfc29c22392f', 'bc0bd319-fba4-4b24-afb4-1024e5c24958', 'f723c00a-32c3-4a5f-9b73-0d174e3101f0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:10 devstack sudo[102176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:10 devstack sudo[102176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:10 devstack sudo[102176]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Deleted volume successfully. Nov 05 11:08:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c32ca269-294a-4463-80df-f00aa21a82d4 tempest-VolumesGetTest-1169072910 None] Lock "cinder-5b49989d-dfb0-4cbc-a120-7a89c7b39442-delete_volume" released by "delete_volume" :: held 1.724s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=147,cinder:SELECT=113,cinder:DELETE=13,cinder:INSERT=41 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Flow 'volume_create_manager' (c4627f60-3359-4449-ab7d-24d0f5e6c4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b535ec7-e4b0-429c-b162-e61d37d6a123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b535ec7-e4b0-429c-b162-e61d37d6a123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-424853841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8739c3b4-819c-4312-899c-bc0b0b065bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694038fd52bc47e3b0157a015510f023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:20Z,use_quota=True,user_id='f91c3203520b43ad9a8d9993f581bcf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f97a8d-f0e8-4e03-a577-93c26787b079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18f97a8d-f0e8-4e03-a577-93c26787b079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c93569-b4f7-410a-afaf-5c28a6e6c009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77c93569-b4f7-410a-afaf-5c28a6e6c009) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8739c3b4-819c-4312-899c-bc0b0b065bce', 'volume_name': 'volume-8739c3b4-819c-4312-899c-bc0b0b065bce', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d65774-7752-44c5-9d6d-05017d8e6ae1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13d65774-7752-44c5-9d6d-05017d8e6ae1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff40f06-9904-4699-9db3-b75d8ed3a56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:20 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Volume 8739c3b4-819c-4312-899c-bc0b0b065bce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8739c3b4-819c-4312-899c-bc0b0b065bce', 'volume_size': 1} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-424853841',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8739c3b4-819c-4312-899c-bc0b0b065bce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='694038fd52bc47e3b0157a015510f023',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:20Z,use_quota=True,user_id='f91c3203520b43ad9a8d9993f581bcf3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Creating volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:20 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:20 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce 1073741824 Nov 05 11:08:20 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:20 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=86,cinder:UPDATE=140,cinder:INSERT=41,cinder:DELETE=14 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:08:21 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce 1073741824" returned: 0 in 0.642s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:21 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce Nov 05 11:08:21 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Acquiring lock "cinder-fda161f3-2d9a-4c3b-8a7c-200b75e1d173-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "cinder-fda161f3-2d9a-4c3b-8a7c-200b75e1d173-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:21 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce" returned: 0 in 0.346s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] <== create_volume: return (1057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.059s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Acquiring lock "cinder-quobyte-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff40f06-9904-4699-9db3-b75d8ed3a56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8739c3b4-819c-4312-899c-bc0b0b065bce', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050aada3-062d-4c58-b857-6ca32d8f320d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "cinder-quobyte-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:21 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Volume volume-8739c3b4-819c-4312-899c-bc0b0b065bce (8739c3b4-819c-4312-899c-bc0b0b065bce): created successfully Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (050aada3-062d-4c58-b857-6ca32d8f320d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Flow 'volume_create_manager' (c4627f60-3359-4449-ab7d-24d0f5e6c4b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d501ccc-44bc-411d-89dd-abff295c72e4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-299e50a2-6ddc-4dd5-964a-b370f4199b48 tempest-VolumesSnapshotListTestJSON-30946299 None] Created volume successfully. Nov 05 11:08:21 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 Nov 05 11:08:21 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:22 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" returned: 0 in 0.398s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:22 devstack sudo[102218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173 Nov 05 11:08:22 devstack sudo[102218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:22 devstack sudo[102218]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" returned: 0 in 0.268s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "cinder-quobyte-fda161f3-2d9a-4c3b-8a7c-200b75e1d173" released by "delete_volume" :: held 0.721s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Created reservations ['e0e2ca44-7abb-4f12-8237-0a289ec4cf54', '8f25bc59-f1bc-460f-b0f3-04ddc1015dd5', '3ebf763f-b878-40fe-8022-9e4aa5258308', 'be0f1302-89c5-437d-9e81-61bbb3844122'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:22 devstack sudo[102221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:22 devstack sudo[102221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:22 devstack sudo[102221]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.387s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Creating offline snapshot fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Deleted volume successfully. Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524fed9-4d98-49ed-9d31-83bcf8f108ee]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59509bee-8903-4736-9883-80d6edef0c0c tempest-VolumesNegativeTest-2088368667 None] Lock "cinder-fda161f3-2d9a-4c3b-8a7c-200b75e1d173-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:23 devstack sudo[102224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce Nov 05 11:08:23 devstack sudo[102224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:23 devstack sudo[102224]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:23 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e 1G Nov 05 11:08:23 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:23 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e 1G" returned: 0 in 0.544s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:23 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:23 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:24 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:24 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e is being set with open permissions: ugo+rw Nov 05 11:08:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:24 devstack sudo[102243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:24 devstack sudo[102243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:24 devstack sudo[102243]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:24 devstack sudo[102246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info Nov 05 11:08:24 devstack sudo[102246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:25 devstack sudo[102246]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:25 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info is being set with open permissions: ugo+rw Nov 05 11:08:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:25 devstack sudo[102249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info Nov 05 11:08:25 devstack sudo[102249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:25 devstack sudo[102249]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.info" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.498s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bf1d8191-8a9b-44d7-a06e-8753858f0d1e tempest-VolumesSnapshotListTestJSON-30946299 None] Create snapshot completed successfully Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Creating offline snapshot 8f955361-4277-4298-b49e-8a21feca5f30 of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[05d82594-63b8-4fc7-9451-4a9334971f8b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:26 devstack sudo[102252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:26 devstack sudo[102252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:26 devstack sudo[102252]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.458s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:26 devstack sudo[102257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 1G Nov 05 11:08:26 devstack sudo[102257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:27 devstack sudo[102257]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Flow 'volume_create_manager' (22445435-3f29-45a3-8f09-a0f55a1459a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac91c558-cb9e-4a90-b340-eee4f54349ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 1G" returned: 0 in 0.846s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac91c558-cb9e-4a90-b340-eee4f54349ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1067176437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f83b61-c029-4f1b-9e16-2dd74b18cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac0bf1fab6b48a1ae5d9797229fd585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:28Z,use_quota=True,user_id='feeaa5a880f24a3a87d78c6ce3b3f817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfad6690-9ad4-4c83-b80d-0962a9d9d68b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfad6690-9ad4-4c83-b80d-0962a9d9d68b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:27 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:27 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bda98-ee5f-46a0-a7da-7c80af2b6559) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (085bda98-ee5f-46a0-a7da-7c80af2b6559) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60f83b61-c029-4f1b-9e16-2dd74b18cf28', 'volume_name': 'volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da850e5a-35e7-45ba-917c-3fcd9f08c357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da850e5a-35e7-45ba-917c-3fcd9f08c357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f63e931-6220-40db-9e93-09cdd227866b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:27 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Volume 60f83b61-c029-4f1b-9e16-2dd74b18cf28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28', 'volume_size': 1} Nov 05 11:08:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:28 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.352s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:28 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 is being set with open permissions: ugo+rw Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:28 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:28 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:28 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.308s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.124s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.627s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1067176437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60f83b61-c029-4f1b-9e16-2dd74b18cf28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac0bf1fab6b48a1ae5d9797229fd585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:28Z,use_quota=True,user_id='feeaa5a880f24a3a87d78c6ce3b3f817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Creating volume 60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:28 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:28 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 1073741824 Nov 05 11:08:28 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8886a1d0-6915-4e16-9fa1-5a6556cf0dcf tempest-VolumesSnapshotListTestJSON-30946299 None] Create snapshot completed successfully Nov 05 11:08:28 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 1073741824" returned: 0 in 0.509s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:28 devstack sudo[102317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:28 devstack sudo[102317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:29 devstack sudo[102317]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.293s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f63e931-6220-40db-9e93-09cdd227866b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092fbf0-7ced-493e-8667-20058ecfeaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:29 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Volume volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 (60f83b61-c029-4f1b-9e16-2dd74b18cf28): created successfully Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e092fbf0-7ced-493e-8667-20058ecfeaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Flow 'volume_create_manager' (22445435-3f29-45a3-8f09-a0f55a1459a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3b964feb-d7bb-4df1-a749-c77d681f13a5 tempest-SnapshotDependencyTests-873956127 None] Created volume successfully. Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Creating offline snapshot 8bdb9f56-b34b-445a-b53d-ae1415e8b89b of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b1fb4e-804e-4693-b0ba-d5fdea5a929f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:29 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:29 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:30 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.542s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:30 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b 1G Nov 05 11:08:30 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:30 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b 1G" returned: 0 in 0.510s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:30 devstack sudo[102330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b Nov 05 11:08:30 devstack sudo[102330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:31 devstack sudo[102330]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b" returned: 0 in 0.389s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:31 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b is being set with open permissions: ugo+rw Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:31 devstack sudo[102335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b Nov 05 11:08:31 devstack sudo[102335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:31 devstack sudo[102335]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b" returned: 0 in 0.293s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.864s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.283s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Creating offline snapshot e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 of volume 60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9d44215e-02bd-4588-8cc4-a5d4e99d397b tempest-VolumesSnapshotListTestJSON-30946299 None] Create snapshot completed successfully Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d838f47-1189-4f5a-b57d-67dc97a2fdc8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:31 devstack sudo[102338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:31 devstack sudo[102338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:32 devstack sudo[102338]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.499s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:32 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 1G Nov 05 11:08:32 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:32 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 1G" returned: 0 in 0.677s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:32 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:32 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-8bdb9f56-b34b-445a-b53d-ae1415e8b89b-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8bdb9f56-b34b-445a-b53d-ae1415e8b89b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8bdb9f56-b34b-445a-b53d-ae1415e8b89b" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8bdb9f56-b34b-445a-b53d-ae1415e8b89b" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Deleting offline snapshot 8bdb9f56-b34b-445a-b53d-ae1415e8b89b of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] snapshot_file for this snap is: volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0157e8fb-f9c6-4327-951b-c7305cd130f9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:33 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.521s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:33 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 is being set with open permissions: ugo+rw Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:33 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:33 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:33 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b Nov 05 11:08:33 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:33 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.315s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:33 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b" returned: 0 in 0.501s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:33 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info Nov 05 11:08:33 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[86021e9a-e7f4-43dc-9bcc-c09d5e8a81b2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:33 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:33 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:33 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info" returned: 0 in 0.344s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:33 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info is being set with open permissions: ugo+rw Nov 05 11:08:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:33 devstack sudo[102369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info Nov 05 11:08:33 devstack sudo[102369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:34 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:34 devstack sudo[102369]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:34 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.info" returned: 0 in 0.280s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:34 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0cd6267d-bb87-4517-97d8-7a3ab0371a00 tempest-SnapshotDependencyTests-873956127 None] Create snapshot completed successfully Nov 05 11:08:34 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b" returned: 0 in 0.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:34 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b Nov 05 11:08:34 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:35 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8bdb9f56-b34b-445a-b53d-ae1415e8b89b" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8bdb9f56-b34b-445a-b53d-ae1415e8b89b" released by "_delete_snapshot" :: held 2.089s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" released by "delete_snapshot" :: held 2.129s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Flow 'volume_create_manager' (8c0a8af1-86d2-4618-9671-f970e51fb755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1247a1ce-7aef-4261-b673-1c6e8d4708b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1247a1ce-7aef-4261-b673-1c6e8d4708b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ac0bf1fab6b48a1ae5d9797229fd585',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:35Z,use_quota=True,user_id='feeaa5a880f24a3a87d78c6ce3b3f817',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f506e4-41f0-470a-b79d-07bbffc223c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5f506e4-41f0-470a-b79d-07bbffc223c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542f851-efb4-4065-9634-7529846cd058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1542f851-efb4-4065-9634-7529846cd058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4', 'volume_name': 'volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4', 'volume_size': 1, 'snapshot_id': 'e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefe9cb-0969-4bd1-97f4-23ad435ac46d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ccefe9cb-0969-4bd1-97f4-23ad435ac46d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c609a420-95e4-4d4a-895d-48b8ce9678e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:35 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Volume 6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4', 'volume_size': 1, 'snapshot_id': 'e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5'} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" acquired by "_create_volume_from_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Creating volume 6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 from snapshot e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] snapshot: e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5, volume: 6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Created reservations ['83799963-e4d5-4894-bf9b-dcfd4ada8abe', '970f2ba6-0e4a-4119-ac9d-a35d0719d6f4', '9acdd4b2-19fc-4d99-94be-1f86af603963', '9f6412b9-a890-4164-b264-39196a248b3c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b689bf4-4f0e-498e-bce5-54408fa0b1aa]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Delete snapshot completed successfully. Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-648a8153-d079-49f0-ab12-7a6013ed5b97 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8bdb9f56-b34b-445a-b53d-ae1415e8b89b-delete_snapshot" released by "delete_snapshot" :: held 2.513s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:35 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:35 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:35 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.393s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c7ad68-fcb3-4754-bfc7-a7464094f7a1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:35 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:35 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-8f955361-4277-4298-b49e-8a21feca5f30-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8f955361-4277-4298-b49e-8a21feca5f30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8f955361-4277-4298-b49e-8a21feca5f30" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8f955361-4277-4298-b49e-8a21feca5f30" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Deleting offline snapshot 8f955361-4277-4298-b49e-8a21feca5f30 of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] snapshot_file for this snap is: volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d77a0fb-1d46-4d16-a07f-048103309b37]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:36 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.550s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:36 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 Nov 05 11:08:36 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:36 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:36 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:36 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.478s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9085ba-a381-47ea-810e-fba8d6b4b1a5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:37 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:37 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:37 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.517s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:37 devstack sudo[102417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:37 devstack sudo[102417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:38 devstack sudo[102417]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.817s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:38 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30 Nov 05 11:08:38 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:38 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.8f955361-4277-4298-b49e-8a21feca5f30" returned: 0 in 0.377s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8f955361-4277-4298-b49e-8a21feca5f30" released by "_delete_snapshot" :: held 2.353s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" released by "delete_snapshot" :: held 2.390s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (19c7fcb1-c563-46fb-87bd-f9e44b0eb9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3648c5-baac-4c4d-9443-45a22e4867ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f3648c5-baac-4c4d-9443-45a22e4867ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1044669284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c615dd93-5f87-4633-a730-a4e26b77af83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:39Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d1f393-3e47-4a0e-9f3e-f55f64b84f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0d1f393-3e47-4a0e-9f3e-f55f64b84f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb027e47-af9f-4663-a624-868724937343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb027e47-af9f-4663-a624-868724937343) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c615dd93-5f87-4633-a730-a4e26b77af83', 'volume_name': 'volume-c615dd93-5f87-4633-a730-a4e26b77af83', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4adcfed-e03e-4eb3-8fb1-1ef0c281a4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4adcfed-e03e-4eb3-8fb1-1ef0c281a4fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8487461a-7c5a-4b4e-a4d4-dca21eb00d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:38 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Volume c615dd93-5f87-4633-a730-a4e26b77af83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c615dd93-5f87-4633-a730-a4e26b77af83', 'volume_size': 1} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Created reservations ['e356d0ac-d60d-414d-8fed-88a29433ad68', 'ce0b10d3-faa5-4712-b4c8-8c687abe9474', 'd0b4785e-f923-4e20-b90f-673ffbf5afb0', '4bd79ec9-382a-4ad1-b196-f32176591a8f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Delete snapshot completed successfully. Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-78b03ef6-041f-4d45-be12-8a26c1f2b49e tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8f955361-4277-4298-b49e-8a21feca5f30-delete_snapshot" released by "delete_snapshot" :: held 2.793s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Deleting offline snapshot fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e of volume 8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] snapshot_file for this snap is: volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[03700a2d-e1ab-43c3-9186-34926bc5f5b3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:39 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:39 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:40 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.504s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8739c3b4-819c-4312-899c-bc0b0b065bce(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea04bc3-a7bf-46c9-8b6a-2acb9e1fbbcd]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:40 devstack sudo[102434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce Nov 05 11:08:40 devstack sudo[102434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:40 devstack sudo[102434]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce" returned: 0 in 0.562s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:40 devstack sudo[102439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:40 devstack sudo[102439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:41 devstack sudo[102439]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.502s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:41 devstack sudo[102444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e Nov 05 11:08:41 devstack sudo[102444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:41 devstack sudo[102444]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce.fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" returned: 0 in 0.343s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e" released by "_delete_snapshot" :: held 2.137s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" released by "delete_snapshot" :: held 2.179s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Created reservations ['06d94f43-8535-4257-ab0a-20151306d344', '1a924619-782b-4b1e-8c79-69b60b3839c5', '1ebb911c-6152-4b91-8f8b-f558ccd35248', 'fb8e724e-f67a-491e-b634-230e13ca9ff9'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Delete snapshot completed successfully. Nov 05 11:08:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06e8bb19-e9e5-4e94-a03d-d9b37a1809a7 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-fd2abd8d-fc89-44b6-a0ff-cf42b0a6530e-delete_snapshot" released by "delete_snapshot" :: held 2.543s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-8739c3b4-819c-4312-899c-bc0b0b065bce-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8739c3b4-819c-4312-899c-bc0b0b065bce-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f31219d-2639-4b52-b2b1-3dbc9e49c945]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" returned: 0 in 6.950s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:08:43 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Converted 1024.00 MB image at 147.31 MB/s Nov 05 11:08:43 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 is being set with open permissions: ugo+rw Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:43 devstack sudo[102448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 Nov 05 11:08:43 devstack sudo[102448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:43 devstack sudo[102447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce Nov 05 11:08:43 devstack sudo[102447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:43 devstack sudo[102448]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" returned: 0 in 0.239s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" released by "_copy_volume_from_snapshot" :: held 8.231s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" released by "_create_volume_from_snapshot" :: held 8.297s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.318s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.755s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1044669284',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c615dd93-5f87-4633-a730-a4e26b77af83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:39Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Creating volume c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:43 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 1073741824 Nov 05 11:08:43 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:43 devstack sudo[102447]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c609a420-95e4-4d4a-895d-48b8ce9678e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4', 'volume_size': 1, 'snapshot_id': 'e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc7160d-e627-4f9c-87b3-7268ea87d7cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:43 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce Nov 05 11:08:43 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Volume volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 (6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4): created successfully Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc7160d-e627-4f9c-87b3-7268ea87d7cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Flow 'volume_create_manager' (8c0a8af1-86d2-4618-9671-f970e51fb755) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-59f6ac53-dcb9-431b-a327-67e6740b1880 tempest-SnapshotDependencyTests-873956127 None] Created volume successfully. Nov 05 11:08:43 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8739c3b4-819c-4312-899c-bc0b0b065bce" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-quobyte-8739c3b4-819c-4312-899c-bc0b0b065bce" released by "delete_volume" :: held 0.786s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Created reservations ['1d4eaadd-9a29-46f2-9599-55333b17a459', 'b8f08983-fdd1-4e61-b2a9-fb163b74c2e2', '60aec08e-22ce-4645-8d34-415d1c8b711c', '10787721-4d6e-47c6-8c8a-5291d865ff8b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:44 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 1073741824" returned: 0 in 0.493s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:44 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:44 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:44 devstack sudo[102466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 Nov 05 11:08:44 devstack sudo[102466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:44 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.249s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Deleted volume successfully. Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4b2e48b9-ac2e-4d79-aec2-d0ceaabb44f6 tempest-VolumesSnapshotListTestJSON-30946299 None] Lock "cinder-8739c3b4-819c-4312-899c-bc0b0b065bce-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:44 devstack sudo[102466]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83" returned: 0 in 0.255s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8487461a-7c5a-4b4e-a4d4-dca21eb00d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c615dd93-5f87-4633-a730-a4e26b77af83', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e29d71-d521-4141-9192-97678f5c0d28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Volume volume-c615dd93-5f87-4633-a730-a4e26b77af83 (c615dd93-5f87-4633-a730-a4e26b77af83): created successfully Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e29d71-d521-4141-9192-97678f5c0d28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (19c7fcb1-c563-46fb-87bd-f9e44b0eb9bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-48c3e40e-76f7-49f7-b8ab-066955758b8b tempest-VolumesSnapshotTestJSON-1476413564 None] Created volume successfully. Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Deleting offline snapshot e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 of volume 60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] snapshot_file for this snap is: volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d75f953-f9b6-4150-9696-d910ba23d066]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:45 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:45 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:45 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.405s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac818761-fbe1-449c-b637-536ef54175d7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:45 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:45 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Creating offline snapshot 0650b595-fe7d-4377-a7ed-8422772f119b of volume c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3d63eb3-6552-4f8b-adab-d2f47101efd5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:46 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 Nov 05 11:08:46 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:46 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.724s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:46 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:46 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:46 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83" returned: 0 in 0.465s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:46 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b 1G Nov 05 11:08:46 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:46 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.423s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:46 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5 Nov 05 11:08:46 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:46 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28.e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:46 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b 1G" returned: 0 in 0.547s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c615dd93-5f87-4633-a730-a4e26b77af83 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5" released by "_delete_snapshot" :: held 1.988s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" released by "delete_snapshot" :: held 2.018s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:46 devstack sudo[102502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c615dd93-5f87-4633-a730-a4e26b77af83 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b Nov 05 11:08:46 devstack sudo[102502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Created reservations ['75cc0142-e733-4c61-b3d5-5bfefb40ef43', 'dab2ab6b-f6ad-451f-b43c-fea1d33c9be9', 'b7bc5d1a-aa3b-4fd4-b58e-67de5fd49290', '5f0243de-bf30-4814-ba37-e0d4f1f98e24'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Delete snapshot completed successfully. Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20351693-48ce-4704-82c6-afd7e041106d tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-e5e5b5ac-ec0c-4f4f-a522-c4da45d603b5-delete_snapshot" released by "delete_snapshot" :: held 2.179s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:47 devstack sudo[102502]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c615dd93-5f87-4633-a730-a4e26b77af83 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b" returned: 0 in 0.345s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:47 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b is being set with open permissions: ugo+rw Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:47 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b Nov 05 11:08:47 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:47 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b" returned: 0 in 0.285s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:47 devstack sudo[102510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info Nov 05 11:08:47 devstack sudo[102510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:47 devstack sudo[102510]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:47 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info is being set with open permissions: ugo+rw Nov 05 11:08:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:47 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info Nov 05 11:08:47 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:48 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.info" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.317s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-60f83b61-c029-4f1b-9e16-2dd74b18cf28-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-60f83b61-c029-4f1b-9e16-2dd74b18cf28-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-21172759-a11a-4ff4-8acd-c17cad9de06d tempest-VolumesSnapshotTestJSON-1476413564 None] Create snapshot completed successfully Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[580d508b-857b-46b3-95f9-37e5898ed55a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:48 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:48 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:48 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.402s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:48 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28 Nov 05 11:08:48 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:49 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-60f83b61-c029-4f1b-9e16-2dd74b18cf28" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-60f83b61-c029-4f1b-9e16-2dd74b18cf28" released by "delete_volume" :: held 0.817s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-0650b595-fe7d-4377-a7ed-8422772f119b-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-0650b595-fe7d-4377-a7ed-8422772f119b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Created reservations ['fc356ce5-01b1-4cc3-821a-d2ea4e68d52e', '0439a8b9-442f-4e4f-9e56-66a695976daa', 'ba24c09c-4679-402d-b209-a26c2b9961e7', '1c12d3a0-4d1f-42e3-a22b-9af7ee704047'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-0650b595-fe7d-4377-a7ed-8422772f119b" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-0650b595-fe7d-4377-a7ed-8422772f119b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleting offline snapshot 0650b595-fe7d-4377-a7ed-8422772f119b of volume c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] snapshot_file for this snap is: volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c744df-ba05-4844-9e86-fca2442aa454]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:49 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:49 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:49 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b Nov 05 11:08:49 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:49 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Deleted volume successfully. Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0ce1528e-ae59-469b-9326-abdfb1574035 tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-60f83b61-c029-4f1b-9e16-2dd74b18cf28-delete_volume" released by "delete_volume" :: held 1.436s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:49 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b" returned: 0 in 0.461s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c615dd93-5f87-4633-a730-a4e26b77af83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09cc2ace-bb56-4394-96d9-eabf5e3731b7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:50 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 Nov 05 11:08:50 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:50 devstack sudo[102540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:50 devstack sudo[102540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:50 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83" returned: 0 in 0.448s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:50 devstack sudo[102544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b Nov 05 11:08:50 devstack sudo[102544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[682e0b50-43b0-4297-8835-befd7719bfbc]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:50 devstack sudo[102540]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.351s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:08:50 devstack sudo[102547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 Nov 05 11:08:50 devstack sudo[102547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:50 devstack sudo[102544]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b" returned: 0 in 0.443s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:50 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b Nov 05 11:08:50 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:50 devstack sudo[102547]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:51 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4 Nov 05 11:08:51 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:51 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83.0650b595-fe7d-4377-a7ed-8422772f119b" returned: 0 in 0.321s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-0650b595-fe7d-4377-a7ed-8422772f119b" released by "_delete_snapshot" :: held 1.822s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" released by "delete_snapshot" :: held 1.856s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['c64d282e-fe69-4305-bef5-454bcd027585', '8c7de1bc-6a6b-4530-9763-9753f72b170f', 'f2645a29-38c2-42a3-a1c2-4bd3df0c4956', '7a572e61-01f1-4a6c-b3df-01f70d1274e0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:51 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-quobyte-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4" released by "delete_volume" :: held 0.848s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Delete snapshot completed successfully. Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-70e4b0e8-24fd-4bdf-b4f2-044f3b4c9895 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-0650b595-fe7d-4377-a7ed-8422772f119b-delete_snapshot" released by "delete_snapshot" :: held 2.193s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Created reservations ['b99a2dc3-9461-43c6-9c06-a6e75e8e78cb', '212182be-1a9d-4d7c-a0f1-f47a5480937c', '93c1b2ed-5eeb-480a-8cac-bfa576ecbdb4', '5ca51b89-fad3-4d4e-a4bc-e549613b9b8e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:51 devstack sudo[102562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:08:51 devstack sudo[102562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:51 devstack sudo[102562]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.323s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:08:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Deleted volume successfully. Nov 05 11:08:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-36e454c9-f272-46d3-993e-6243842e140c tempest-SnapshotDependencyTests-873956127 None] Lock "cinder-6f9eb9ac-9384-45db-b0e2-85d0d4ee88b4-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (266e76db-c137-4757-8323-bb6f1ecdd1e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f72cc0-d9ef-4bbc-965d-e0e00353efc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77f72cc0-d9ef-4bbc-965d-e0e00353efc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-447187547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af963329-6fb9-4ded-9ea6-9a344e99ccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:53Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626060f6-fa92-4fe3-bdb7-e78cdc2b8976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (626060f6-fa92-4fe3-bdb7-e78cdc2b8976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77109b2f-f486-4ff0-8b72-9d8547a6d335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (77109b2f-f486-4ff0-8b72-9d8547a6d335) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af963329-6fb9-4ded-9ea6-9a344e99ccdd', 'volume_name': 'volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5848124-d8a2-4787-8b12-f260d7f5dbcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a5848124-d8a2-4787-8b12-f260d7f5dbcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff28662-6716-421a-b192-82ac8fdc57ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume af963329-6fb9-4ded-9ea6-9a344e99ccdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd', 'volume_size': 1} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-447187547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af963329-6fb9-4ded-9ea6-9a344e99ccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:53Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Creating volume af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:53 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:53 devstack sudo[102565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd 1073741824 Nov 05 11:08:53 devstack sudo[102565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:53 devstack sudo[102565]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd 1073741824" returned: 0 in 0.551s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:53 devstack sudo[102572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:08:53 devstack sudo[102572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:54 devstack sudo[102572]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.282s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cff28662-6716-421a-b192-82ac8fdc57ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b7283-cc6c-4b72-9e3b-39390cab7193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd (af963329-6fb9-4ded-9ea6-9a344e99ccdd): created successfully Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c8b7283-cc6c-4b72-9e3b-39390cab7193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (266e76db-c137-4757-8323-bb6f1ecdd1e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7e97d1ca-5f8f-4db0-87d7-aef57dc4d6b9 tempest-VolumesSnapshotTestJSON-1476413564 None] Created volume successfully. Nov 05 11:08:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Creating offline snapshot 8ca2b595-fa0f-421d-9823-e22c42734ab5 of volume af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:08:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[154b1d4b-3c52-4d22-9ced-ce0a42066ebf]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:55 devstack sudo[102575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:08:55 devstack sudo[102575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:56 devstack sudo[102575]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:56 devstack sudo[102580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 1G Nov 05 11:08:56 devstack sudo[102580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:56 devstack sudo[102580]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 1G" returned: 0 in 0.548s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:56 devstack sudo[102586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:08:56 devstack sudo[102586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:56 devstack sudo[102586]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.405s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:56 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 is being set with open permissions: ugo+rw Nov 05 11:08:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:57 devstack sudo[102592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:08:57 devstack sudo[102592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:57 devstack sudo[102592]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:57 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info Nov 05 11:08:57 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:57 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:57 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info is being set with open permissions: ugo+rw Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:57 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info Nov 05 11:08:57 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:08:57 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.info" returned: 0 in 0.250s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:08:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.392s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-834b72e3-3217-451b-bece-f5608ed3915b tempest-VolumesSnapshotTestJSON-1476413564 None] Create snapshot completed successfully Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (196a9ba1-1ee0-4f22-8080-f90edf18b598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab812a2-26b9-4553-b6e4-240976f0ea59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab812a2-26b9-4553-b6e4-240976f0ea59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-456382720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:08:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8ca2b595-fa0f-421d-9823-e22c42734ab5,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:08:59Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37d72ce-1866-4740-a879-8f48528dc815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f37d72ce-1866-4740-a879-8f48528dc815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa48bf1-0870-40f6-82ec-d32c9dd05a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffa48bf1-0870-40f6-82ec-d32c9dd05a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3', 'volume_name': 'volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3', 'volume_size': 2, 'snapshot_id': '8ca2b595-fa0f-421d-9823-e22c42734ab5'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc676e9-4d13-44e9-9ec4-a85957c62d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2cc676e9-4d13-44e9-9ec4-a85957c62d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6c8351-85a0-44ce-9a09-1ec32a7427fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:08:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume 13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3', 'volume_size': 2, 'snapshot_id': '8ca2b595-fa0f-421d-9823-e22c42734ab5'} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Creating volume 13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 from snapshot 8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] snapshot: 8ca2b595-fa0f-421d-9823-e22c42734ab5, volume: 13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[42cdb859-c353-4c41-8580-62f805786402]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:08:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:08:59 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:08:59 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:00 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.482s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6747d7f-5f7f-4714-99be-3d04083d64fa]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:00 devstack sudo[102610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:09:00 devstack sudo[102610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:00 devstack sudo[102610]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.501s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:09:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:00 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 Nov 05 11:09:00 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:08 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" returned: 0 in 8.239s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:08 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd, size 1024.00 MB, duration 8.24 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:09:08 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Converted 1024.00 MB image at 124.26 MB/s Nov 05 11:09:08 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 is being set with open permissions: ugo+rw Nov 05 11:09:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:08 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 Nov 05 11:09:08 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:09 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" released by "_copy_volume_from_snapshot" :: held 9.653s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" released by "_create_volume_from_snapshot" :: held 9.730s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.747s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6c8351-85a0-44ce-9a09-1ec32a7427fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3', 'volume_size': 2, 'snapshot_id': '8ca2b595-fa0f-421d-9823-e22c42734ab5'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f656ee3-3f0b-4973-b046-a5245adc48c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:09 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 (13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3): created successfully Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f656ee3-3f0b-4973-b046-a5245adc48c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (196a9ba1-1ee0-4f22-8080-f90edf18b598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-10174ea5-2d6a-4eb1-a167-8dc83d60c090 tempest-VolumesSnapshotTestJSON-1476413564 None] Created volume successfully. Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ad3b092-63b9-4756-995d-a24d5ae96d79]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:10 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 Nov 05 11:09:10 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:11 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:11 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3 Nov 05 11:09:11 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:11 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" returned: 0 in 0.317s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3" released by "delete_volume" :: held 0.850s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['e722d9ae-1113-471c-881a-92e5b7b3b148', '0f9cdbc0-835a-458c-ad83-a7d888a17b81', '3d602653-6e61-4bda-a869-eb9f41fd4793', '5738c5f5-80ef-41e9-ba84-9e9f2b34fa82'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:11 devstack sudo[102649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:11 devstack sudo[102649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-8ca2b595-fa0f-421d-9823-e22c42734ab5-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-8ca2b595-fa0f-421d-9823-e22c42734ab5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleting offline snapshot 8ca2b595-fa0f-421d-9823-e22c42734ab5 of volume af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] snapshot_file for this snap is: volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[992dc679-f317-4c83-b467-dc03cfea8d0b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:11 devstack sudo[102649]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.376s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:11 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleted volume successfully. Nov 05 11:09:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7d80f913-0646-436d-9192-844793e612d1 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-13613b9a-2f0d-4cc8-8cef-d24ef9f1fbb3-delete_volume" released by "delete_volume" :: held 1.500s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:12 devstack sudo[102652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:09:12 devstack sudo[102652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:12 devstack sudo[102652]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:09:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0dec05-7875-4566-8251-aac3a5dc5b89]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:12 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:09:12 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:13 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.604s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:13 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:09:13 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:13 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:13 devstack sudo[102672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5 Nov 05 11:09:13 devstack sudo[102672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:13 devstack sudo[102672]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd.8ca2b595-fa0f-421d-9823-e22c42734ab5" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-8ca2b595-fa0f-421d-9823-e22c42734ab5" released by "_delete_snapshot" :: held 1.961s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" released by "delete_snapshot" :: held 2.018s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['ec1e3cc4-9356-4ca3-b71d-b67b1d11efac', '3333630e-02be-4ae3-935e-cf883875b342', 'a591957b-8d48-4489-a8a3-6d162d97eeee', 'a7a78774-abc4-4c89-aa4f-4955187296a5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:14 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Delete snapshot completed successfully. Nov 05 11:09:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-8af826a9-69e9-482b-b1d9-dbabfcac68a3 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-8ca2b595-fa0f-421d-9823-e22c42734ab5-delete_snapshot" released by "delete_snapshot" :: held 2.202s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-af963329-6fb9-4ded-9ea6-9a344e99ccdd-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-af963329-6fb9-4ded-9ea6-9a344e99ccdd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda3d20f-8e8f-4423-91ee-84577bbf0c29]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:15 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:09:15 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:15 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.408s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:15 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd Nov 05 11:09:15 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:15 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af963329-6fb9-4ded-9ea6-9a344e99ccdd" returned: 0 in 0.257s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-af963329-6fb9-4ded-9ea6-9a344e99ccdd" released by "delete_volume" :: held 0.743s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['a02c388b-2969-422e-9385-1946bf11aacf', '092bf7dc-0818-477e-9f72-88c8c56ee6db', 'cccd26ed-6795-4458-8849-d6c8bf1737e2', '7825b511-fecb-4dbd-9489-7c9e6e09d236'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:16 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:16 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:16 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.311s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleted volume successfully. Nov 05 11:09:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-17f96274-b7ef-492e-a41e-19336c755cb4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-af963329-6fb9-4ded-9ea6-9a344e99ccdd-delete_volume" released by "delete_volume" :: held 1.329s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (185cac31-2edb-40fd-a4ac-697b77ddcdfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2d283-688a-4b89-9e43-a2fcd51f9474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bf2d283-688a-4b89-9e43-a2fcd51f9474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337098106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9889be53-1994-4e80-b641-7d2df96a1aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:09:17Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cc31c3-cd63-4d47-9616-323e76d79b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7cc31c3-cd63-4d47-9616-323e76d79b2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f108ae7d-563a-42bd-b264-2ea5b15ced6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f108ae7d-563a-42bd-b264-2ea5b15ced6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9889be53-1994-4e80-b641-7d2df96a1aa3', 'volume_name': 'volume-9889be53-1994-4e80-b641-7d2df96a1aa3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ebf3f0-de12-4cd6-91f5-86fccd369d1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ebf3f0-de12-4cd6-91f5-86fccd369d1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb103f71-756b-4511-bef7-c0a833f26656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume 9889be53-1994-4e80-b641-7d2df96a1aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9889be53-1994-4e80-b641-7d2df96a1aa3', 'volume_size': 1} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1337098106',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9889be53-1994-4e80-b641-7d2df96a1aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:09:17Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Creating volume 9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:09:17 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:17 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 1073741824 Nov 05 11:09:17 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Flow 'volume_create_manager' (da2f34a2-f2a6-444c-b281-50c7bb9f734d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d78c1-caab-4ec0-b07b-93fb1e2b72fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136d78c1-caab-4ec0-b07b-93fb1e2b72fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1800320417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7da06c-6211-4b19-852d-c172de8c3785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e5edd59a384c27a7ff35703dffff9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:09:17Z,use_quota=True,user_id='463ddef817354baeac8fe978a2d6511c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a623cc6-949f-4585-ae61-daeb2f5143ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a623cc6-949f-4585-ae61-daeb2f5143ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41253c41-3a33-42ef-9477-65b646b20d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41253c41-3a33-42ef-9477-65b646b20d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed7da06c-6211-4b19-852d-c172de8c3785', 'volume_name': 'volume-ed7da06c-6211-4b19-852d-c172de8c3785', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e8984a-29e1-4d20-9d13-bcc99fd4ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e8984a-29e1-4d20-9d13-bcc99fd4ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557c54c0-21d8-4271-bc2d-a019ff0f34ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Volume ed7da06c-6211-4b19-852d-c172de8c3785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed7da06c-6211-4b19-852d-c172de8c3785', 'volume_size': 1} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:17 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 1073741824" returned: 0 in 0.471s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:17 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:17 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:17 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.663s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:09:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1800320417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed7da06c-6211-4b19-852d-c172de8c3785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e5edd59a384c27a7ff35703dffff9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:09:17Z,use_quota=True,user_id='463ddef817354baeac8fe978a2d6511c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Creating volume ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:09:17 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:17 devstack sudo[102696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 1073741824 Nov 05 11:09:17 devstack sudo[102696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb103f71-756b-4511-bef7-c0a833f26656) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9889be53-1994-4e80-b641-7d2df96a1aa3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db516f-ce59-437d-b0a5-2bbf51ba8dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Volume volume-9889be53-1994-4e80-b641-7d2df96a1aa3 (9889be53-1994-4e80-b641-7d2df96a1aa3): created successfully Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15db516f-ce59-437d-b0a5-2bbf51ba8dca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (185cac31-2edb-40fd-a4ac-697b77ddcdfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6f9c67ae-4cf8-4957-84ec-4df6ff52e745 tempest-VolumesSnapshotTestJSON-1476413564 None] Created volume successfully. Nov 05 11:09:18 devstack sudo[102696]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 1073741824" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:18 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:09:18 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:18 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.253s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (557c54c0-21d8-4271-bc2d-a019ff0f34ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed7da06c-6211-4b19-852d-c172de8c3785', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f99afe-2b15-470f-9d5f-ca2208449ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Volume volume-ed7da06c-6211-4b19-852d-c172de8c3785 (ed7da06c-6211-4b19-852d-c172de8c3785): created successfully Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5f99afe-2b15-470f-9d5f-ca2208449ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Flow 'volume_create_manager' (da2f34a2-f2a6-444c-b281-50c7bb9f734d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2ede2398-4fab-42e1-bf83-5233cebe0209 tempest-TestStampPattern-823474563 None] Created volume successfully. Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Creating offline snapshot ccf7acfb-9494-497a-ac9d-45070cecb49f of volume 9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f1cb804-e139-463a-ad18-a3d8c1b9538f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:19 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:19 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:19 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.439s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:19 devstack sudo[102724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f 1G Nov 05 11:09:19 devstack sudo[102724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:20 devstack sudo[102724]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f 1G" returned: 0 in 0.551s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9889be53-1994-4e80-b641-7d2df96a1aa3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:20 devstack sudo[102737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9889be53-1994-4e80-b641-7d2df96a1aa3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:20 devstack sudo[102737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:20 devstack sudo[102737]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9889be53-1994-4e80-b641-7d2df96a1aa3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.309s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:20 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f is being set with open permissions: ugo+rw Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:20 devstack sudo[102742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:20 devstack sudo[102742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:20 devstack sudo[102742]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.251s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=118,cinder:INSERT=33,cinder:UPDATE=115,cinder:DELETE=10 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=97,cinder:UPDATE=114,cinder:INSERT=27,cinder:DELETE=10 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:20 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info Nov 05 11:09:20 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:21 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:21 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info is being set with open permissions: ugo+rw Nov 05 11:09:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:21 devstack sudo[102748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info Nov 05 11:09:21 devstack sudo[102748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:21 devstack sudo[102748]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.info" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-eeb878f8-b08e-46c3-aed5-c6a0fcd6a4c4 tempest-VolumesSnapshotTestJSON-1476413564 None] Create snapshot completed successfully Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (76bf1fce-b690-44b9-b353-27a2d1f163d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ec65c-3f1f-4d43-a260-852c8ac9001d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307ec65c-3f1f-4d43-a260-852c8ac9001d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1650228440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a76b4c08-f8ec-4491-8c43-ad73998a6ff0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ff93dfd909b24eff87658b8c8f698972',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ccf7acfb-9494-497a-ac9d-45070cecb49f,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:09:23Z,use_quota=True,user_id='6b3690c1f3ec4843a51c8025fed51f68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a758f4-40e0-4827-ac1c-7ebf7404f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0a758f4-40e0-4827-ac1c-7ebf7404f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a4d27-8695-47df-929e-29ef0aedc4a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (622a4d27-8695-47df-929e-29ef0aedc4a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a76b4c08-f8ec-4491-8c43-ad73998a6ff0', 'volume_name': 'volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0', 'volume_size': 1, 'snapshot_id': 'ccf7acfb-9494-497a-ac9d-45070cecb49f'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3619319a-0cc1-48fb-a145-d1030c8e35af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3619319a-0cc1-48fb-a145-d1030c8e35af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc98e157-e794-41c7-99fa-55de0d1858d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Volume a76b4c08-f8ec-4491-8c43-ad73998a6ff0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0', 'volume_size': 1, 'snapshot_id': 'ccf7acfb-9494-497a-ac9d-45070cecb49f'} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Creating volume a76b4c08-f8ec-4491-8c43-ad73998a6ff0 from snapshot ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] snapshot: ccf7acfb-9494-497a-ac9d-45070cecb49f, volume: a76b4c08-f8ec-4491-8c43-ad73998a6ff0, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e1a9c6-b298-4f23-97de-223d575a15be]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:23 devstack sudo[102820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:23 devstack sudo[102820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:24 devstack sudo[102820]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.487s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9889be53-1994-4e80-b641-7d2df96a1aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b180305-6255-4aa9-87cb-477049827278]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:24 devstack sudo[102827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:24 devstack sudo[102827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:24 devstack sudo[102827]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:09:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:24 devstack sudo[102832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 Nov 05 11:09:24 devstack sudo[102832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:33 devstack sudo[102832]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" returned: 0 in 8.753s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3, size 1024.00 MB, duration 8.75 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:09:33 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Converted 1024.00 MB image at 116.97 MB/s Nov 05 11:09:33 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 is being set with open permissions: ugo+rw Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:33 devstack sudo[102894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 Nov 05 11:09:33 devstack sudo[102894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=2,cinder:SELECT=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:33 devstack sudo[102894]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" returned: 0 in 0.248s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" released by "_copy_volume_from_snapshot" :: held 10.020s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" released by "_create_volume_from_snapshot" :: held 10.096s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.114s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc98e157-e794-41c7-99fa-55de0d1858d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0', 'volume_size': 1, 'snapshot_id': 'ccf7acfb-9494-497a-ac9d-45070cecb49f'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c11008-bebb-4de5-920a-560da276d137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:09:33 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Volume volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 (a76b4c08-f8ec-4491-8c43-ad73998a6ff0): created successfully Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81c11008-bebb-4de5-920a-560da276d137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:09:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Flow 'volume_create_manager' (76bf1fce-b690-44b9-b353-27a2d1f163d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:09:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-98abd631-908a-43f4-b7f8-4aa657a5cb6d tempest-VolumesSnapshotTestJSON-1476413564 None] Created volume successfully. Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-a76b4c08-f8ec-4491-8c43-ad73998a6ff0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-a76b4c08-f8ec-4491-8c43-ad73998a6ff0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b667d483-0e9f-4ccc-b5ef-f48be6264ddd]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:34 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 Nov 05 11:09:34 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" returned: 0 in 0.386s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:35 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0 Nov 05 11:09:35 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:35 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" returned: 0 in 0.233s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-a76b4c08-f8ec-4491-8c43-ad73998a6ff0" released by "delete_volume" :: held 0.664s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['575867d9-9ae0-4296-83f0-3ed670cb75cb', 'f0bde2aa-36c5-4c4e-af78-ed66f3b3b282', 'ef31683c-a5f5-4a76-82c9-360c7583b751', 'd729828a-2032-4338-8251-e26b1a181fa5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:35 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:35 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:35 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleted volume successfully. Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4c998f82-fbb9-4c27-b2f9-4e3e8c333378 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-a76b4c08-f8ec-4491-8c43-ad73998a6ff0-delete_volume" released by "delete_volume" :: held 1.161s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-ccf7acfb-9494-497a-ac9d-45070cecb49f-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-ccf7acfb-9494-497a-ac9d-45070cecb49f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleting offline snapshot ccf7acfb-9494-497a-ac9d-45070cecb49f of volume 9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] snapshot_file for this snap is: volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[462cf276-4cac-4176-930f-2d40d91b01cf]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:36 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:36 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:36 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.365s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9889be53-1994-4e80-b641-7d2df96a1aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[43751e36-b9c5-4949-8e8a-2d3c8c006fd8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:36 devstack sudo[102925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:36 devstack sudo[102925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:36 devstack sudo[102925]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.512s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:36 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:36 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:37 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.328s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:37 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f Nov 05 11:09:37 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:37 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3.ccf7acfb-9494-497a-ac9d-45070cecb49f" returned: 0 in 0.239s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-ccf7acfb-9494-497a-ac9d-45070cecb49f" released by "_delete_snapshot" :: held 1.549s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" released by "delete_snapshot" :: held 1.574s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['946a27ac-6f88-475e-b4f4-72a92be88dc3', 'f095c207-086e-4fb2-9021-63e82fa30ec6', '7b01cf7e-32e1-4148-9a63-25d8b975d0e5', '0fdb8702-9846-40ee-a1ad-c2dcb4a31fea'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Delete snapshot completed successfully. Nov 05 11:09:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-987283b6-18e4-44ad-b9bd-912171d08642 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-ccf7acfb-9494-497a-ac9d-45070cecb49f-delete_snapshot" released by "delete_snapshot" :: held 1.697s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-9889be53-1994-4e80-b641-7d2df96a1aa3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-9889be53-1994-4e80-b641-7d2df96a1aa3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96eac74-e84a-4ae2-b43e-caa8b3f6b471]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:38 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:38 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:38 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.355s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:38 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3 Nov 05 11:09:38 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:38 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9889be53-1994-4e80-b641-7d2df96a1aa3" returned: 0 in 0.233s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-9889be53-1994-4e80-b641-7d2df96a1aa3" released by "delete_volume" :: held 0.648s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['d199b738-3f2f-4886-8744-0a3b813a0b38', 'e163bb98-05cb-4f5c-a099-04299e217e63', 'f20b1d68-abd8-47f7-bf32-361c3fe6e081', '4f63e6a3-7319-4c16-ab70-28581438abc8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:38 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:38 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:39 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.235s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Deleted volume successfully. Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-11f2e9cc-997f-47fa-a63b-5b7537360a11 tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-9889be53-1994-4e80-b641-7d2df96a1aa3-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-c615dd93-5f87-4633-a730-a4e26b77af83-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-c615dd93-5f87-4633-a730-a4e26b77af83-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7450b457-3e7d-4b72-886d-2fc113161456]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:39 devstack sudo[102951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 Nov 05 11:09:39 devstack sudo[102951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:39 devstack sudo[102951]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83" returned: 0 in 0.360s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:39 devstack sudo[102956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83 Nov 05 11:09:39 devstack sudo[102956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:39 devstack sudo[102956]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c615dd93-5f87-4633-a730-a4e26b77af83" returned: 0 in 0.240s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-quobyte-c615dd93-5f87-4633-a730-a4e26b77af83" released by "delete_volume" :: held 0.660s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Created reservations ['1c95db16-2020-4189-97d4-5917a69895fb', '611a809d-6097-4ddc-89e2-a36cd372dd0c', 'e2063fed-4307-4320-b2ff-ac620f9cdaad', 'e8d02859-6de6-42ff-953f-168c6a58b559'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:40 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:40 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:40 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.237s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Deleted volume successfully. Nov 05 11:09:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-20571de1-3fad-42b1-93cb-41a3124853cf tempest-VolumesSnapshotTestJSON-1476413564 None] Lock "cinder-c615dd93-5f87-4633-a730-a4e26b77af83-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=21,cinder:UPDATE=36,cinder:INSERT=10,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:50 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:09:50 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=23,cinder:UPDATE=28,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:09:50 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:09:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:09:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-cf3c8df2-7a79-4267-beeb-460156f38f99 req-8233893f-ea1a-47c8-b476-6aaf52b1a991 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-cf3c8df2-7a79-4267-beeb-460156f38f99 req-8233893f-ea1a-47c8-b476-6aaf52b1a991 tempest-TestStampPattern-823474563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-cf3c8df2-7a79-4267-beeb-460156f38f99 req-8233893f-ea1a-47c8-b476-6aaf52b1a991 tempest-TestStampPattern-823474563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:09:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-cf3c8df2-7a79-4267-beeb-460156f38f99 req-8233893f-ea1a-47c8-b476-6aaf52b1a991 tempest-TestStampPattern-823474563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-ed7da06c-6211-4b19-852d-c172de8c3785', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c0e93bde-1be9-431f-adc3-9491c7eee075', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:09:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-cf3c8df2-7a79-4267-beeb-460156f38f99 req-8233893f-ea1a-47c8-b476-6aaf52b1a991 tempest-TestStampPattern-823474563 None] attachment_update completed successfully. Nov 05 11:09:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-b5c9b3af-7b0d-4e68-80b3-2d717e561227 req-6343c30d-0ef8-497a-b1de-fdb42828b032 tempest-TestStampPattern-823474563 None] Terminate volume connection completed successfully. Nov 05 11:09:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-b5c9b3af-7b0d-4e68-80b3-2d717e561227 req-6343c30d-0ef8-497a-b1de-fdb42828b032 tempest-TestStampPattern-823474563 None] Deleting attachment c0e93bde-1be9-431f-adc3-9491c7eee075. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Creating offline snapshot d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd of volume ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bde8f58-9bd5-42bc-a195-50a097d2648c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:58 devstack sudo[103451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:09:58 devstack sudo[103451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:58 devstack sudo[103451]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:58 devstack sudo[103456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd 1G Nov 05 11:09:58 devstack sudo[103456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:59 devstack sudo[103456]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd 1G" returned: 0 in 0.470s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da06c-6211-4b19-852d-c172de8c3785 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:59 devstack sudo[103462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da06c-6211-4b19-852d-c172de8c3785 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:09:59 devstack sudo[103462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:59 devstack sudo[103462]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed7da06c-6211-4b19-852d-c172de8c3785 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.312s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:59 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd is being set with open permissions: ugo+rw Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:59 devstack sudo[103467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:09:59 devstack sudo[103467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:09:59 devstack sudo[103467]: pam_unix(sudo:session): session closed for user root Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:09:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:09:59 devstack sudo[103470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info Nov 05 11:09:59 devstack sudo[103470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:00 devstack sudo[103470]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info" returned: 0 in 0.265s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:00 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info is being set with open permissions: ugo+rw Nov 05 11:10:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:00 devstack sudo[103473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info Nov 05 11:10:00 devstack sudo[103473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:00 devstack sudo[103473]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.info" returned: 0 in 0.277s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.164s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6334dae1-37e0-455c-ac7c-1a93cde129c4 tempest-TestStampPattern-823474563 None] Create snapshot completed successfully Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Flow 'volume_create_manager' (84cad086-2bf4-4b91-b4f8-332ebe2b9684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f49c2df-cb3b-4d59-bb5f-a30b67750240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f49c2df-cb3b-4d59-bb5f-a30b67750240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1381381188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=209732d4-0054-46f7-ae68-3ef12389e82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e8e5edd59a384c27a7ff35703dffff9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:10:08Z,use_quota=True,user_id='463ddef817354baeac8fe978a2d6511c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb50dd-7382-49e9-9169-371fea295020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3fb50dd-7382-49e9-9169-371fea295020) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7812979-b4b0-4a8f-bc01-8fa66aef113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7812979-b4b0-4a8f-bc01-8fa66aef113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '209732d4-0054-46f7-ae68-3ef12389e82d', 'volume_name': 'volume-209732d4-0054-46f7-ae68-3ef12389e82d', 'volume_size': 1, 'snapshot_id': 'd1664cc5-99e5-4cb9-b150-9bb95c2dc2dd'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbf4a01-a381-4746-ad49-b9fbb1c2cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ddbf4a01-a381-4746-ad49-b9fbb1c2cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e033a7-b505-499e-a5a9-b935bebd1190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:08 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Volume 209732d4-0054-46f7-ae68-3ef12389e82d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-209732d4-0054-46f7-ae68-3ef12389e82d', 'volume_size': 1, 'snapshot_id': 'd1664cc5-99e5-4cb9-b150-9bb95c2dc2dd'} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-209732d4-0054-46f7-ae68-3ef12389e82d" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-209732d4-0054-46f7-ae68-3ef12389e82d" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Creating volume 209732d4-0054-46f7-ae68-3ef12389e82d from snapshot d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] snapshot: d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd, volume: 209732d4-0054-46f7-ae68-3ef12389e82d, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a8a2ee1-78c4-41ee-9cb3-489a5af35483]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:10:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:08 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:10:08 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:09 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.492s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7da06c-6211-4b19-852d-c172de8c3785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a32c56-e2ff-4e9e-9397-d769c60c6ab5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:09 devstack sudo[103517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:10:09 devstack sudo[103517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:09 devstack sudo[103517]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.420s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:10:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:09 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d Nov 05 11:10:09 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:18 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=12,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:10:18 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=14,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:10:18 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d" returned: 0 in 9.165s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:18 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:10:18 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Converted 1024.00 MB image at 111.72 MB/s Nov 05 11:10:18 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d is being set with open permissions: ugo+rw Nov 05 11:10:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:18 devstack sudo[103579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d Nov 05 11:10:18 devstack sudo[103579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:19 devstack sudo[103579]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d" returned: 0 in 0.657s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" released by "_copy_volume_from_snapshot" :: held 10.854s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-209732d4-0054-46f7-ae68-3ef12389e82d" released by "_create_volume_from_snapshot" :: held 10.955s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.987s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7e033a7-b505-499e-a5a9-b935bebd1190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-209732d4-0054-46f7-ae68-3ef12389e82d', 'volume_size': 1, 'snapshot_id': 'd1664cc5-99e5-4cb9-b150-9bb95c2dc2dd'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84570fe4-bc65-42e6-ab3f-05fbe8553f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Volume volume-209732d4-0054-46f7-ae68-3ef12389e82d (209732d4-0054-46f7-ae68-3ef12389e82d): created successfully Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84570fe4-bc65-42e6-ab3f-05fbe8553f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Flow 'volume_create_manager' (84cad086-2bf4-4b91-b4f8-332ebe2b9684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:10:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-39ff1cdd-a7e2-43cb-85e6-7a7efcf24e8e tempest-TestStampPattern-823474563 None] Created volume successfully. Nov 05 11:10:29 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:10:29 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Flow 'volume_create_manager' (f8df2b12-5428-4bc5-9a62-8cf8c74fdd06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53286d20-8a31-493a-beef-934c59277ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53286d20-8a31-493a-beef-934c59277ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-374258520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40619cf7-f593-4404-8a2d-d8fbf92debf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9775eaec121a424a9bc4418ae3802cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:10:48Z,use_quota=True,user_id='6d23a36a844a4175814d7fefb51984b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1458f0-7f52-4df6-87a5-773f48a3a516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f1458f0-7f52-4df6-87a5-773f48a3a516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a5d802-d69c-4626-9cdb-b3949fb7136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23a5d802-d69c-4626-9cdb-b3949fb7136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40619cf7-f593-4404-8a2d-d8fbf92debf1', 'volume_name': 'volume-40619cf7-f593-4404-8a2d-d8fbf92debf1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0d3f9c-4d23-47de-b4d5-f024608ddebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d0d3f9c-4d23-47de-b4d5-f024608ddebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb6c4b4-5606-4c06-922d-1f51c6dd7cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Volume 40619cf7-f593-4404-8a2d-d8fbf92debf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40619cf7-f593-4404-8a2d-d8fbf92debf1', 'volume_size': 1} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:10:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-374258520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40619cf7-f593-4404-8a2d-d8fbf92debf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9775eaec121a424a9bc4418ae3802cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:10:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:10:48Z,use_quota=True,user_id='6d23a36a844a4175814d7fefb51984b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Creating volume 40619cf7-f593-4404-8a2d-d8fbf92debf1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:10:48 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:48 devstack sudo[103801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 1073741824 Nov 05 11:10:48 devstack sudo[103801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:48 devstack sudo[103801]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 1073741824" returned: 0 in 0.457s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:48 devstack sudo[103806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 Nov 05 11:10:48 devstack sudo[103806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:49 devstack sudo[103806]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1" returned: 0 in 0.285s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5bb6c4b4-5606-4c06-922d-1f51c6dd7cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40619cf7-f593-4404-8a2d-d8fbf92debf1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806cf34d-9abd-49f0-802d-6113856101e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:10:49 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Volume volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 (40619cf7-f593-4404-8a2d-d8fbf92debf1): created successfully Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (806cf34d-9abd-49f0-802d-6113856101e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:10:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Flow 'volume_create_manager' (f8df2b12-5428-4bc5-9a62-8cf8c74fdd06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:10:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-97cb2e16-a2cd-435d-aae2-de10d534c653 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Created volume successfully. Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:50 devstack sudo[103809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:10:50 devstack sudo[103809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:50 devstack sudo[103809]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.294s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:10:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:10:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ad799731-3348-4390-a0a4-d6e753d957d4 req-5845aede-3a8a-4522-888f-5083b2fd7df1 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ad799731-3348-4390-a0a4-d6e753d957d4 req-5845aede-3a8a-4522-888f-5083b2fd7df1 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-ad799731-3348-4390-a0a4-d6e753d957d4 req-5845aede-3a8a-4522-888f-5083b2fd7df1 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-ad799731-3348-4390-a0a4-d6e753d957d4 req-5845aede-3a8a-4522-888f-5083b2fd7df1 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-40619cf7-f593-4404-8a2d-d8fbf92debf1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1a2adece-8954-4b5c-ba56-bf818a996729', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:10:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-ad799731-3348-4390-a0a4-d6e753d957d4 req-5845aede-3a8a-4522-888f-5083b2fd7df1 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] attachment_update completed successfully. Nov 05 11:10:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-565fd34b-6c6a-4175-8d09-ac152245b017 req-b8f71a11-bae1-47e3-b017-6d686c515196 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Terminate volume connection completed successfully. Nov 05 11:10:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-565fd34b-6c6a-4175-8d09-ac152245b017 req-b8f71a11-bae1-47e3-b017-6d686c515196 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Deleting attachment 1a2adece-8954-4b5c-ba56-bf818a996729. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "cinder-40619cf7-f593-4404-8a2d-d8fbf92debf1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "cinder-40619cf7-f593-4404-8a2d-d8fbf92debf1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "cinder-quobyte-40619cf7-f593-4404-8a2d-d8fbf92debf1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "cinder-quobyte-40619cf7-f593-4404-8a2d-d8fbf92debf1" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b502ae-3850-401a-90bc-58921535bf4e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:10:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:55 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 Nov 05 11:10:55 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:56 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:56 devstack sudo[104272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1 Nov 05 11:10:56 devstack sudo[104272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:56 devstack sudo[104272]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-40619cf7-f593-4404-8a2d-d8fbf92debf1" returned: 0 in 0.260s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "cinder-quobyte-40619cf7-f593-4404-8a2d-d8fbf92debf1" released by "delete_volume" :: held 0.719s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Created reservations ['59ac3255-bffc-4e8b-a190-cb0888567826', '372c1fdf-5e74-4a9c-9381-99eea6d44a78', 'a064148e-9d06-4cbd-a0fd-86c60e825b2a', '9ed15296-4661-430d-b608-74539dd1cacc'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:10:56 devstack sudo[104275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:10:56 devstack sudo[104275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:10:56 devstack sudo[104275]: pam_unix(sudo:session): session closed for user root Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.250s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:10:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Deleted volume successfully. Nov 05 11:10:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e3105b21-7de0-470f-a216-ccbf4067e092 tempest-TestServerVolumeAttachScenarioOldVersion-1067502419 None] Lock "cinder-40619cf7-f593-4404-8a2d-d8fbf92debf1-delete_volume" released by "delete_volume" :: held 1.191s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-93dbced4-80bb-47f6-b237-c3e74e5d6b3b req-c764817f-4b92-4420-bd2e-00cec5276e15 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-93dbced4-80bb-47f6-b237-c3e74e5d6b3b req-c764817f-4b92-4420-bd2e-00cec5276e15 tempest-TestStampPattern-823474563 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-93dbced4-80bb-47f6-b237-c3e74e5d6b3b req-c764817f-4b92-4420-bd2e-00cec5276e15 tempest-TestStampPattern-823474563 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-93dbced4-80bb-47f6-b237-c3e74e5d6b3b req-c764817f-4b92-4420-bd2e-00cec5276e15 tempest-TestStampPattern-823474563 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-209732d4-0054-46f7-ae68-3ef12389e82d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'dddfe3f5-fc8b-4090-8000-27889d6dd2a2', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:11:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-93dbced4-80bb-47f6-b237-c3e74e5d6b3b req-c764817f-4b92-4420-bd2e-00cec5276e15 tempest-TestStampPattern-823474563 None] attachment_update completed successfully. Nov 05 11:11:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-36c18f61-bb84-4e74-9798-10fe52292126 req-2068e473-9ce6-44bd-9e30-cda1545e0a0e tempest-TestStampPattern-823474563 None] Terminate volume connection completed successfully. Nov 05 11:11:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-36c18f61-bb84-4e74-9798-10fe52292126 req-2068e473-9ce6-44bd-9e30-cda1545e0a0e tempest-TestStampPattern-823474563 None] Deleting attachment dddfe3f5-fc8b-4090-8000-27889d6dd2a2. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-209732d4-0054-46f7-ae68-3ef12389e82d-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "cinder-209732d4-0054-46f7-ae68-3ef12389e82d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27a5eba-4d3f-4573-85f6-596452f71d90]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:11 devstack sudo[104816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d Nov 05 11:11:11 devstack sudo[104816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:12 devstack sudo[104816]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d" returned: 0 in 0.442s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:12 devstack sudo[104821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d Nov 05 11:11:12 devstack sudo[104821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:12 devstack sudo[104821]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-209732d4-0054-46f7-ae68-3ef12389e82d" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-209732d4-0054-46f7-ae68-3ef12389e82d" released by "delete_volume" :: held 0.763s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Created reservations ['5e1d4bfa-f533-43fb-ab51-d7b3ce89f6cf', 'fb40dd5e-d131-4e52-9c1c-215d458a4d06', '29a13d31-cf2a-4e6c-a4bb-7925170b6f6d', '011e8b19-d4de-44bc-ae8f-8a6cca000dac'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:12 devstack sudo[104824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:12 devstack sudo[104824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:12 devstack sudo[104824]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Deleted volume successfully. Nov 05 11:11:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-67882228-b9f9-4808-a282-9a23085070d8 tempest-TestStampPattern-823474563 None] Lock "cinder-209732d4-0054-46f7-ae68-3ef12389e82d-delete_volume" released by "delete_volume" :: held 1.410s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Deleting offline snapshot d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd of volume ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] snapshot_file for this snap is: volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc7509-aae1-4ecd-b15c-342a80066fc7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:13 devstack sudo[104827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:11:13 devstack sudo[104827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:13 devstack sudo[104827]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.404s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed7da06c-6211-4b19-852d-c172de8c3785(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bba9ea3-a079-4bf2-b47a-ee620fd066d1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:13 devstack sudo[104832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:11:13 devstack sudo[104832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:14 devstack sudo[104832]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.630s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:14 devstack sudo[104838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:11:14 devstack sudo[104838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:14 devstack sudo[104838]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.422s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:14 devstack sudo[104843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd Nov 05 11:11:14 devstack sudo[104843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:14 devstack sudo[104843]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785.d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" returned: 0 in 0.356s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd" released by "_delete_snapshot" :: held 1.951s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" released by "delete_snapshot" :: held 1.984s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:15 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Created reservations ['6dd1ceb0-b702-43b8-ad59-5c6f3aca1395', '91083f08-c50c-47ee-940e-d0bd2d7d33bb', '466d1ff2-9b1b-4c3b-9c08-27deb92477a7', '11b67435-3148-401f-9ae4-cc213f5e2670'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Delete snapshot completed successfully. Nov 05 11:11:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7c0de55a-ffd5-422e-a73d-18c04e17a1fe tempest-TestStampPattern-823474563 None] Lock "cinder-d1664cc5-99e5-4cb9-b150-9bb95c2dc2dd-delete_snapshot" released by "delete_snapshot" :: held 2.152s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-ed7da06c-6211-4b19-852d-c172de8c3785-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "cinder-ed7da06c-6211-4b19-852d-c172de8c3785-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Acquiring lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d64dcbb-4067-46e4-8ed5-6211ab48c8a5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:21 devstack sudo[104880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:11:21 devstack sudo[104880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:21 devstack sudo[104880]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.504s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:21 devstack sudo[104886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785 Nov 05 11:11:21 devstack sudo[104886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:22 devstack sudo[104886]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ed7da06c-6211-4b19-852d-c172de8c3785" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "cinder-quobyte-ed7da06c-6211-4b19-852d-c172de8c3785" released by "delete_volume" :: held 0.903s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Created reservations ['7fb04b36-3e78-4e7d-9c06-cbdefb050af3', 'fcc70d3e-10f2-4db1-8c2a-80577500515f', '7728c287-4b95-4888-b930-ad36152baddc', '100879bc-e29a-4793-9c5e-835236afa745'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:22 devstack sudo[104889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:22 devstack sudo[104889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:22 devstack sudo[104889]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Deleted volume successfully. Nov 05 11:11:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b6035ba7-fc53-47a7-b4b0-0bfa5a8eb70a tempest-TestStampPattern-823474563 None] Lock "cinder-ed7da06c-6211-4b19-852d-c172de8c3785-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:32 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=42,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:11:32 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=34,cinder:UPDATE=39,cinder:INSERT=8,cinder:DELETE=3 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (ddad7f45-9f86-4fbd-b9d2-17460a1644f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676fce14-31fe-4361-8bed-e1036ab97238) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (676fce14-31fe-4361-8bed-e1036ab97238) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794304370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a51eddd-01c1-475d-8270-f308a9c76d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:39Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326c573-a4f7-4fd3-9ddd-71f2941ae2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e326c573-a4f7-4fd3-9ddd-71f2941ae2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed200932-8c52-4bb8-9174-29ab25a0283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed200932-8c52-4bb8-9174-29ab25a0283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a51eddd-01c1-475d-8270-f308a9c76d80', 'volume_name': 'volume-6a51eddd-01c1-475d-8270-f308a9c76d80', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f81a3e-d543-42d8-be38-8f0d11bfad02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76f81a3e-d543-42d8-be38-8f0d11bfad02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38803559-ab43-45e4-b142-a875853b8b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Volume 6a51eddd-01c1-475d-8270-f308a9c76d80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a51eddd-01c1-475d-8270-f308a9c76d80', 'volume_size': 1} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1794304370',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a51eddd-01c1-475d-8270-f308a9c76d80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:39Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Creating volume 6a51eddd-01c1-475d-8270-f308a9c76d80 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:39 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:39 devstack sudo[104937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 1073741824 Nov 05 11:11:39 devstack sudo[104937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (e960f842-83ff-4d85-9e77-4f7c1d50a7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54390bc4-e626-4e9e-9f9e-53a56f62707f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (54390bc4-e626-4e9e-9f9e-53a56f62707f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582630495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e76e469-5f1a-4037-8635-1c04514ee831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:40Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75db8d0-b489-4f1d-ae7c-2f66d19ae041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a75db8d0-b489-4f1d-ae7c-2f66d19ae041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde6191a-03ea-40e0-802f-6cdc8720598c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dde6191a-03ea-40e0-802f-6cdc8720598c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e76e469-5f1a-4037-8635-1c04514ee831', 'volume_name': 'volume-4e76e469-5f1a-4037-8635-1c04514ee831', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa3558-3c37-4af2-8ba3-5e46aef35c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1faa3558-3c37-4af2-8ba3-5e46aef35c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f37e14b-6ac0-4494-8a26-4243e203dfb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:39 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Volume 4e76e469-5f1a-4037-8635-1c04514ee831: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e76e469-5f1a-4037-8635-1c04514ee831', 'volume_size': 1} Nov 05 11:11:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:40 devstack sudo[104937]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 1073741824" returned: 0 in 0.673s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:40 devstack sudo[104943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 Nov 05 11:11:40 devstack sudo[104943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (dca8592c-3f56-4cdb-92ff-86e086d9522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274caaa6-ffa9-41f4-9f9e-43c359c989cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (274caaa6-ffa9-41f4-9f9e-43c359c989cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592034171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69845358-06d4-4d6d-bef5-22e3ce561c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:40Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e064b1f-9d1b-47ac-8f4e-745face89baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e064b1f-9d1b-47ac-8f4e-745face89baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d11bd2-9cbb-478f-8cd5-7ccb730e004d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34d11bd2-9cbb-478f-8cd5-7ccb730e004d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69845358-06d4-4d6d-bef5-22e3ce561c00', 'volume_name': 'volume-69845358-06d4-4d6d-bef5-22e3ce561c00', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26de540f-db62-4926-a01f-cae612feeed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26de540f-db62-4926-a01f-cae612feeed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616bbf22-3947-46f2-b88f-4298f14f41f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Volume 69845358-06d4-4d6d-bef5-22e3ce561c00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69845358-06d4-4d6d-bef5-22e3ce561c00', 'volume_size': 1} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:40 devstack sudo[104943]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] <== create_volume: return (1128ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.131s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.769s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1582630495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e76e469-5f1a-4037-8635-1c04514ee831,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:40Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Creating volume 4e76e469-5f1a-4037-8635-1c04514ee831 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:40 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38803559-ab43-45e4-b142-a875853b8b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a51eddd-01c1-475d-8270-f308a9c76d80', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7816e3-1a9b-4279-945a-c7aa38ae9b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Volume volume-6a51eddd-01c1-475d-8270-f308a9c76d80 (6a51eddd-01c1-475d-8270-f308a9c76d80): created successfully Nov 05 11:11:40 devstack sudo[104946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 1073741824 Nov 05 11:11:40 devstack sudo[104946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff7816e3-1a9b-4279-945a-c7aa38ae9b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (ddad7f45-9f86-4fbd-b9d2-17460a1644f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:40 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1a2634f8-f121-4742-a1e7-aa04e5e4919f tempest-CreateVolumesFromImageTest-1967938682 None] Created volume successfully. Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (2bebe31d-cdcb-4283-ac9c-a8702c2aac61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e931acd-f867-40b0-ad26-82627e865106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e931acd-f867-40b0-ad26-82627e865106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14132357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:41Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f7a7d-cc4e-4caf-bf82-d2d5a0eb2720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c26f7a7d-cc4e-4caf-bf82-d2d5a0eb2720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2cb39a-6863-4607-8cb9-ec54d78644a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf2cb39a-6863-4607-8cb9-ec54d78644a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c', 'volume_name': 'volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b226e-2d27-4b3c-9530-25ae0fbef0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (865b226e-2d27-4b3c-9530-25ae0fbef0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf5a7ec-8b9f-4551-a421-733c82e7b6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:40 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Volume cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c', 'volume_size': 1} Nov 05 11:11:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:41 devstack sudo[104946]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 1073741824" returned: 0 in 0.828s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:41 devstack sudo[104952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 Nov 05 11:11:41 devstack sudo[104952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (198b8eea-05e5-4ea6-a1d5-f5327bf7a5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70372272-dc82-4778-ae5f-0a3132fbef40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70372272-dc82-4778-ae5f-0a3132fbef40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637505392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c361e812-1ebc-46ae-9cdb-a992970c9010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:41Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255cd925-b87b-4cc6-8757-a3abb4e0c5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (255cd925-b87b-4cc6-8757-a3abb4e0c5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abca5156-2ee0-4dc5-96b5-65e60c6dac3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abca5156-2ee0-4dc5-96b5-65e60c6dac3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c361e812-1ebc-46ae-9cdb-a992970c9010', 'volume_name': 'volume-c361e812-1ebc-46ae-9cdb-a992970c9010', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8a1e9-96ec-49c0-84c5-b03207f4860e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79e8a1e9-96ec-49c0-84c5-b03207f4860e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646746e3-77b1-454c-8ed1-8a86cd4a6ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Volume c361e812-1ebc-46ae-9cdb-a992970c9010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c361e812-1ebc-46ae-9cdb-a992970c9010', 'volume_size': 1} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:41 devstack sudo[104952]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831" returned: 0 in 0.337s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.277s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.318s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592034171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=69845358-06d4-4d6d-bef5-22e3ce561c00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:40Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Creating volume 69845358-06d4-4d6d-bef5-22e3ce561c00 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:41 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f37e14b-6ac0-4494-8a26-4243e203dfb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e76e469-5f1a-4037-8635-1c04514ee831', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 1073741824 Nov 05 11:11:41 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c807ad1e-2af0-4e93-a7c0-c32ef91beff3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:41 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Volume volume-4e76e469-5f1a-4037-8635-1c04514ee831 (4e76e469-5f1a-4037-8635-1c04514ee831): created successfully Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c807ad1e-2af0-4e93-a7c0-c32ef91beff3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:41 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (e960f842-83ff-4d85-9e77-4f7c1d50a7ef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4aace20b-7d01-4dea-b9ad-f58f300d6fa2 tempest-CreateVolumesFromImageTest-1967938682 None] Created volume successfully. Nov 05 11:11:42 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 1073741824" returned: 0 in 0.564s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:42 devstack sudo[104960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 Nov 05 11:11:42 devstack sudo[104960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Flow 'volume_create_manager' (123984f8-0db2-4c2a-8f1d-c6b0c4514ce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c043680-e9bb-42de-bfbe-71d95c425447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c043680-e9bb-42de-bfbe-71d95c425447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780078244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043afb71-6306-449e-bcec-8cdf70ac46f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794136c014144116954b87f922a71371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:42Z,use_quota=True,user_id='26205b07542441c8bb01e552ed842451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950460fd-8b5a-45bb-a2d9-dea764a1876b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (950460fd-8b5a-45bb-a2d9-dea764a1876b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcefcd0-20f2-4b05-885f-d155260382cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbcefcd0-20f2-4b05-885f-d155260382cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '043afb71-6306-449e-bcec-8cdf70ac46f1', 'volume_name': 'volume-043afb71-6306-449e-bcec-8cdf70ac46f1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6bf19c-5ac0-416b-933c-f20ab96a3bed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac6bf19c-5ac0-416b-933c-f20ab96a3bed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bb815-841c-46bb-a684-5455b81b5e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume 043afb71-6306-449e-bcec-8cdf70ac46f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-043afb71-6306-449e-bcec-8cdf70ac46f1', 'volume_size': 1} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:42 devstack sudo[104960]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.699s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-14132357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:41Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Creating volume cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:42 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (616bbf22-3947-46f2-b88f-4298f14f41f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69845358-06d4-4d6d-bef5-22e3ce561c00', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c 1073741824 Nov 05 11:11:42 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6728ab8-c0d8-4d62-be5e-e3edcece51bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Volume volume-69845358-06d4-4d6d-bef5-22e3ce561c00 (69845358-06d4-4d6d-bef5-22e3ce561c00): created successfully Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6728ab8-c0d8-4d62-be5e-e3edcece51bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (dca8592c-3f56-4cdb-92ff-86e086d9522f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a6e3a1e4-4d95-42c0-823a-0d5003456572 tempest-CreateVolumesFromImageTest-1967938682 None] Created volume successfully. Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Flow 'volume_create_manager' (55267e8b-e746-4554-a74e-4af7a98b8d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b988ba-d884-4370-a846-7637b444e514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33b988ba-d884-4370-a846-7637b444e514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-927088664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794136c014144116954b87f922a71371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:43Z,use_quota=True,user_id='26205b07542441c8bb01e552ed842451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11520fcd-28de-44a5-8d2e-dc5f7c194387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11520fcd-28de-44a5-8d2e-dc5f7c194387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d19f4-78be-40c6-bd5a-39ba860732c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e0d19f4-78be-40c6-bd5a-39ba860732c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d', 'volume_name': 'volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405c06d-ded0-47ea-9fc7-33404375f953) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5405c06d-ded0-47ea-9fc7-33404375f953) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03c1790-31b0-4623-a05a-11988cdd45a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d', 'volume_size': 1} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:43 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c 1073741824" returned: 0 in 0.532s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:43 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c Nov 05 11:11:43 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:43 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.909s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-637505392',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c361e812-1ebc-46ae-9cdb-a992970c9010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='170f22b6f32d485884cde116034e9587',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:41Z,use_quota=True,user_id='97ae8ec133494a319d0032b83f73b756',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Creating volume c361e812-1ebc-46ae-9cdb-a992970c9010 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:43 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 1073741824 Nov 05 11:11:43 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bf5a7ec-8b9f-4551-a421-733c82e7b6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e993578-70a9-4dc6-902a-79a967af2ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Volume volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c (cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c): created successfully Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e993578-70a9-4dc6-902a-79a967af2ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (2bebe31d-cdcb-4283-ac9c-a8702c2aac61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-34576bbc-011f-48c3-a321-792438383ceb tempest-CreateVolumesFromImageTest-1967938682 None] Created volume successfully. Nov 05 11:11:44 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 1073741824" returned: 0 in 0.564s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:44 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 Nov 05 11:11:44 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:44 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.867s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-780078244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=043afb71-6306-449e-bcec-8cdf70ac46f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794136c014144116954b87f922a71371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:42Z,use_quota=True,user_id='26205b07542441c8bb01e552ed842451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Creating volume 043afb71-6306-449e-bcec-8cdf70ac46f1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:44 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:44 devstack sudo[104982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 1073741824 Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (646746e3-77b1-454c-8ed1-8a86cd4a6ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c361e812-1ebc-46ae-9cdb-a992970c9010', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:44 devstack sudo[104982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeab4d6-62a4-4073-b2cd-ad38d8fa1db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Volume volume-c361e812-1ebc-46ae-9cdb-a992970c9010 (c361e812-1ebc-46ae-9cdb-a992970c9010): created successfully Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2eeab4d6-62a4-4073-b2cd-ad38d8fa1db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Flow 'volume_create_manager' (198b8eea-05e5-4ea6-a1d5-f5327bf7a5fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-601fdfcb-dd76-4c63-9e24-875c9f02e393 tempest-CreateVolumesFromImageTest-1967938682 None] Created volume successfully. Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-c361e812-1ebc-46ae-9cdb-a992970c9010-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:44 devstack sudo[104982]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 1073741824" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-c361e812-1ebc-46ae-9cdb-a992970c9010-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-quobyte-c361e812-1ebc-46ae-9cdb-a992970c9010" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-c361e812-1ebc-46ae-9cdb-a992970c9010" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:45 devstack sudo[104988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 Nov 05 11:11:45 devstack sudo[104988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf3e451-e46e-498c-8f5f-980553235439]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:45 devstack sudo[104990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 Nov 05 11:11:45 devstack sudo[104990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:45 devstack sudo[104988]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1" returned: 0 in 0.288s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.331s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-927088664',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='794136c014144116954b87f922a71371',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:43Z,use_quota=True,user_id='26205b07542441c8bb01e552ed842451',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Creating volume af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:45 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:45 devstack sudo[104994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d 1073741824 Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b98bb815-841c-46bb-a684-5455b81b5e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-043afb71-6306-449e-bcec-8cdf70ac46f1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:45 devstack sudo[104994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e466335-d52b-476e-9030-0c6e826be689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume volume-043afb71-6306-449e-bcec-8cdf70ac46f1 (043afb71-6306-449e-bcec-8cdf70ac46f1): created successfully Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e466335-d52b-476e-9030-0c6e826be689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Flow 'volume_create_manager' (123984f8-0db2-4c2a-8f1d-c6b0c4514ce1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-93bc99c2-806c-45b3-8448-7a714778eeb0 tempest-TestServerVolumeAttachmentScenario-501465879 None] Created volume successfully. Nov 05 11:11:45 devstack sudo[104990]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010" returned: 0 in 0.493s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:45 devstack sudo[105000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010 Nov 05 11:11:45 devstack sudo[105000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:45 devstack sudo[105000]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c361e812-1ebc-46ae-9cdb-a992970c9010" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:45 devstack sudo[104994]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-c361e812-1ebc-46ae-9cdb-a992970c9010" released by "delete_volume" :: held 0.853s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d 1073741824" returned: 0 in 0.579s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:46 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d Nov 05 11:11:46 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Created reservations ['25596e13-d3ac-4304-b83e-1af85b6855ef', 'ff24e31d-fda9-4f20-a792-5ee48b5f46b0', 'b80717de-31b0-4249-967f-0685aa6fd65d', '858a017d-20a4-44c1-b351-eca83c05de90'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:46 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:46 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c-delete_volume" acquired by "delete_volume" :: waited 0.120s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:46 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" returned: 0 in 0.420s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] <== create_volume: return (1063ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d03c1790-31b0-4623-a05a-11988cdd45a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510366ee-7008-40aa-9afa-b03dbaf60d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-quobyte-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Volume volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d (af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d): created successfully Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510366ee-7008-40aa-9afa-b03dbaf60d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Flow 'volume_create_manager' (55267e8b-e746-4554-a74e-4af7a98b8d55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-39305da6-00a4-4d96-9091-27a70304f23d tempest-TestServerVolumeAttachmentScenario-501465879 None] Created volume successfully. Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" acquired by "delete_volume" :: waited 0.043s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec46eb7-3d85-48d4-afbb-b3c107a06a9a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:46 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.362s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:46 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Deleted volume successfully. Nov 05 11:11:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5ad3a451-5986-4a38-b7e7-1e5675a1bb75 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-c361e812-1ebc-46ae-9cdb-a992970c9010-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:46 devstack sudo[105015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c Nov 05 11:11:46 devstack sudo[105015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:47 devstack sudo[105015]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" returned: 0 in 0.491s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:47 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c Nov 05 11:11:47 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:47 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" returned: 0 in 0.305s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c" released by "delete_volume" :: held 0.859s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Created reservations ['183fea96-bdcd-408c-b116-666cf761b040', 'bb30918b-c374-4d9c-81a2-0b75e5c08a8f', 'e11ac8d9-51ea-4cd7-adff-b81b5014a13f', '0882180d-684c-41c7-a106-b81dd2ea9281'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:47 devstack sudo[105023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:47 devstack sudo[105023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:47 devstack sudo[105023]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.302s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Deleted volume successfully. Nov 05 11:11:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-16f0fa5c-84ad-47bf-9f3a-4f7d51e08ab2 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-cf9d7a7b-26a6-4d61-a638-27dfdb5a3d6c-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-69845358-06d4-4d6d-bef5-22e3ce561c00-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-69845358-06d4-4d6d-bef5-22e3ce561c00-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-quobyte-69845358-06d4-4d6d-bef5-22e3ce561c00" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-69845358-06d4-4d6d-bef5-22e3ce561c00" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc426526-c6d8-40bc-b1ba-e0916fc8e3e7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:48 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 Nov 05 11:11:48 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:49 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00" returned: 0 in 0.404s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:49 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00 Nov 05 11:11:49 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:49 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-69845358-06d4-4d6d-bef5-22e3ce561c00" returned: 0 in 0.270s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-69845358-06d4-4d6d-bef5-22e3ce561c00" released by "delete_volume" :: held 0.730s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Created reservations ['6aa811da-bddb-4ea7-b37d-4c2b467ab815', '2b6b114a-5f06-4b3e-acab-9771d57bf01e', '6118282a-462d-4699-9b6c-a11f654525ac', '639b41c7-b6a9-4b9e-9709-4bededa1fc6e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:49 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:49 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-4e76e469-5f1a-4037-8635-1c04514ee831-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-4e76e469-5f1a-4037-8635-1c04514ee831-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-quobyte-4e76e469-5f1a-4037-8635-1c04514ee831" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-4e76e469-5f1a-4037-8635-1c04514ee831" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:49 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.371s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:49 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Deleted volume successfully. Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ebdbe25-a840-4130-9648-51afd9ae24d8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f6bf346b-c35b-4bff-9c83-f9cd9f01a4f8 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-69845358-06d4-4d6d-bef5-22e3ce561c00-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:50 devstack sudo[105057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 Nov 05 11:11:50 devstack sudo[105057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:50 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:50 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:50 devstack sudo[105057]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831" returned: 0 in 0.472s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:50 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:11:50 devstack sudo[105065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831 Nov 05 11:11:50 devstack sudo[105065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:11:50 devstack sudo[105065]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4e76e469-5f1a-4037-8635-1c04514ee831" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-4e76e469-5f1a-4037-8635-1c04514ee831" released by "delete_volume" :: held 1.014s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Created reservations ['a6d9b2a5-be4b-4bd8-9b1b-e1654b7e46e9', '252446c6-68e4-40d2-9533-5544bd4b6381', 'f96d7022-7da7-45c8-a1ea-64efc782a8dd', '52ae1342-d6e7-4a90-bc48-981a8171ea2f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:51 devstack sudo[105123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:51 devstack sudo[105123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:51 devstack sudo[105123]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.394s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Deleted volume successfully. Nov 05 11:11:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d192b1fb-9ee4-41e0-89b9-213b349a27ff tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-4e76e469-5f1a-4037-8635-1c04514ee831-delete_volume" released by "delete_volume" :: held 1.861s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-6a51eddd-01c1-475d-8270-f308a9c76d80-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-6a51eddd-01c1-475d-8270-f308a9c76d80-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "cinder-quobyte-6a51eddd-01c1-475d-8270-f308a9c76d80" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-6a51eddd-01c1-475d-8270-f308a9c76d80" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09de5e57-0c7c-46a5-9995-ada86455896a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:52 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 Nov 05 11:11:52 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:52 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80" returned: 0 in 0.452s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:52 devstack sudo[105146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80 Nov 05 11:11:52 devstack sudo[105146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:53 devstack sudo[105146]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6a51eddd-01c1-475d-8270-f308a9c76d80" returned: 0 in 0.297s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-quobyte-6a51eddd-01c1-475d-8270-f308a9c76d80" released by "delete_volume" :: held 0.805s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Created reservations ['6ede1f17-025a-41ce-b0b9-8800dc1dc383', '4e93f86f-5489-4e3e-ab73-bdfef228d864', '18d379d4-230a-4753-ab17-8e47e87b1469', '3aae9321-81c7-4ed2-94c4-9e2fadd7183a'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:53 devstack sudo[105149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:11:53 devstack sudo[105149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:53 devstack sudo[105149]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.413s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:11:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Deleted volume successfully. Nov 05 11:11:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-edb70b77-d48e-4080-8611-b20d6f5bf339 tempest-CreateVolumesFromImageTest-1967938682 None] Lock "cinder-6a51eddd-01c1-475d-8270-f308a9c76d80-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (b105d494-94a1-4bb7-a765-fbb5901b4c5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd8c636-2efa-4dbe-938a-4ea9a130cd16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4bd8c636-2efa-4dbe-938a-4ea9a130cd16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401735708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:57Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858be81b-8d27-431d-b4c2-594bace3c8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (858be81b-8d27-431d-b4c2-594bace3c8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0e68c4-3d09-4bfb-b9ba-7e1898b25465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c0e68c4-3d09-4bfb-b9ba-7e1898b25465) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f', 'volume_name': 'volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e54da1-b811-4c13-920f-7ff27f5e5fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e54da1-b811-4c13-920f-7ff27f5e5fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cec5b-3cf4-4328-9e79-08aab06bc062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f', 'volume_size': 1} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1401735708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:57Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:57 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:57 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f 1073741824 Nov 05 11:11:57 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:57 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f 1073741824" returned: 0 in 0.432s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:57 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f Nov 05 11:11:57 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:57 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a90cec5b-3cf4-4328-9e79-08aab06bc062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc39ed5-5b2c-4d23-aef7-89472f3776b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f (cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f): created successfully Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc39ed5-5b2c-4d23-aef7-89472f3776b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (b105d494-94a1-4bb7-a765-fbb5901b4c5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-786bd373-330f-4b31-999b-18cb1fb7dfcc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (bbbdfb7d-cbc4-4ad2-9cb0-510c3a94edcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d07b16-7c14-40a4-8cb0-2c0b71478093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67d07b16-7c14-40a4-8cb0-2c0b71478093) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907438827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c125d54a-c2e0-436c-bd97-a62f660e1a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:59Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb2e7d-c3a8-4c4d-b159-088373093983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73cb2e7d-c3a8-4c4d-b159-088373093983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc49c5c-0df7-4d56-a12e-b9f0adba3926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dc49c5c-0df7-4d56-a12e-b9f0adba3926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c125d54a-c2e0-436c-bd97-a62f660e1a45', 'volume_name': 'volume-c125d54a-c2e0-436c-bd97-a62f660e1a45', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf27d65-4f06-4991-9ea1-0ff68c5d9546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daf27d65-4f06-4991-9ea1-0ff68c5d9546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e35618e-4642-44f1-8202-0531b45b2cc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume c125d54a-c2e0-436c-bd97-a62f660e1a45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c125d54a-c2e0-436c-bd97-a62f660e1a45', 'volume_size': 1} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1907438827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c125d54a-c2e0-436c-bd97-a62f660e1a45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:59Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume c125d54a-c2e0-436c-bd97-a62f660e1a45 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:58 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:58 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 1073741824 Nov 05 11:11:58 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (90df4ade-93a6-4e33-9522-81667c5d14b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10b56ab-eeeb-460b-a780-dd2d49f75815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f10b56ab-eeeb-460b-a780-dd2d49f75815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131820902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cc6df6-f080-4440-90c4-8fde19c7e82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:59Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e237fddc-37ed-4e70-bb61-86dbeeb65f19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e237fddc-37ed-4e70-bb61-86dbeeb65f19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3304447d-69d1-483b-a439-b0d2d461d18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3304447d-69d1-483b-a439-b0d2d461d18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0cc6df6-f080-4440-90c4-8fde19c7e82b', 'volume_name': 'volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dfac2f-ceb0-4752-8ecb-418075391ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0dfac2f-ceb0-4752-8ecb-418075391ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c161e8-4b3e-45f9-a989-a1451256d432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume b0cc6df6-f080-4440-90c4-8fde19c7e82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b', 'volume_size': 1} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:59 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 1073741824" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:11:59 devstack sudo[105169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 Nov 05 11:11:59 devstack sudo[105169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (1dba65dc-a9e7-46fd-970f-dc129a4e06f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae93a67-aa43-4e57-be61-19754194f587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae93a67-aa43-4e57-be61-19754194f587) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212165805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:00Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c3a877-13fa-4fb0-9530-2e852422a83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (94c3a877-13fa-4fb0-9530-2e852422a83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46c8dd3-78c3-4207-b875-c11bd89ecacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d46c8dd3-78c3-4207-b875-c11bd89ecacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0', 'volume_name': 'volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84345489-b6ef-4dec-b2d1-b2a26154a632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84345489-b6ef-4dec-b2d1-b2a26154a632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4252ba-54d8-4a20-8dbc-c27789f170a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:11:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume 11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0', 'volume_size': 1} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:59 devstack sudo[105169]: pam_unix(sudo:session): session closed for user root Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45" returned: 0 in 0.538s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (1203ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.648s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-131820902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0cc6df6-f080-4440-90c4-8fde19c7e82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:11:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:11:59Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume b0cc6df6-f080-4440-90c4-8fde19c7e82b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:11:59 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:11:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e35618e-4642-44f1-8202-0531b45b2cc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c125d54a-c2e0-436c-bd97-a62f660e1a45', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b 1073741824 Nov 05 11:12:00 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4c04f-eeb7-4ecc-b0f8-1c3f45a13aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 (c125d54a-c2e0-436c-bd97-a62f660e1a45): created successfully Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc4c04f-eeb7-4ecc-b0f8-1c3f45a13aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (bbbdfb7d-cbc4-4ad2-9cb0-510c3a94edcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e5d8c446-8891-4ca6-b277-6516a93b519e tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (f356230f-fd8f-4255-9a8b-b41e9a05798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c660fa-0859-4b5b-b675-b5e7c29a47db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2c660fa-0859-4b5b-b675-b5e7c29a47db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178474341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:00Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f572cede-cd54-45e8-875d-7ce54294c18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f572cede-cd54-45e8-875d-7ce54294c18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c70737-0d3d-4f30-9529-c3065a12c3f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c70737-0d3d-4f30-9529-c3065a12c3f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4', 'volume_name': 'volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f5356b-8989-430e-aaf8-5732cd00017e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1f5356b-8989-430e-aaf8-5732cd00017e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d714dd5-38ad-465a-a7b7-5d0d3f5530d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume 7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4', 'volume_size': 1} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:00 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b 1073741824" returned: 0 in 0.636s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (239717ec-151a-423a-8eb1-c5e59f00f642) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b60839f-2509-48f7-8db1-3a8fc72e1fe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b60839f-2509-48f7-8db1-3a8fc72e1fe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933030498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3ec528-15c9-47b2-8e50-2e269b7b8af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:01Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab41bf2-9d4f-47fe-9b6d-d958edf85087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ab41bf2-9d4f-47fe-9b6d-d958edf85087) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbb2ad1-206f-4ef9-8157-d231f160ca5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dbb2ad1-206f-4ef9-8157-d231f160ca5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b3ec528-15c9-47b2-8e50-2e269b7b8af0', 'volume_name': 'volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487d138a-2eb1-4c4c-8e2e-7c1b33a3dc1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (487d138a-2eb1-4c4c-8e2e-7c1b33a3dc1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9840888-be0e-49cb-9fcb-d073824b2434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume 3b3ec528-15c9-47b2-8e50-2e269b7b8af0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0', 'volume_size': 1} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:00 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b Nov 05 11:12:00 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:00 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.297s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:11:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1212165805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:00Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume 11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c161e8-4b3e-45f9-a989-a1451256d432) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756e6a8c-2a5e-4b34-9d38-fe84daac354a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:01 devstack sudo[105181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 1073741824 Nov 05 11:12:01 devstack sudo[105181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b (b0cc6df6-f080-4440-90c4-8fde19c7e82b): created successfully Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (756e6a8c-2a5e-4b34-9d38-fe84daac354a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (90df4ade-93a6-4e33-9522-81667c5d14b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b1b4bd8c-add1-4c20-977a-3674e0398a1c tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:12:01 devstack sudo[105181]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 1073741824" returned: 0 in 0.498s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:01 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 Nov 05 11:12:01 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:01 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.457s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1178474341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:00Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume 7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf4252ba-54d8-4a20-8dbc-c27789f170a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:01 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 1073741824 Nov 05 11:12:01 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0afe47c-eee7-45e9-b6e8-03486a4e32ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 (11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0): created successfully Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0afe47c-eee7-45e9-b6e8-03486a4e32ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:01 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (1dba65dc-a9e7-46fd-970f-dc129a4e06f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-69bca054-6dc4-4335-b582-ef69adf52d6d tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:12:02 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 1073741824" returned: 0 in 0.477s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:02 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 Nov 05 11:12:02 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:02 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.795s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.880s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-933030498',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b3ec528-15c9-47b2-8e50-2e269b7b8af0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='09998450257d477abb2fc416680052d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:01Z,use_quota=True,user_id='d6c9d82236134cd4a25bac985a5d9ec8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Creating volume 3b3ec528-15c9-47b2-8e50-2e269b7b8af0 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:02 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d714dd5-38ad-465a-a7b7-5d0d3f5530d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:02 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 1073741824 Nov 05 11:12:02 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070feed3-3b13-48f2-a897-b72d02417210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:02 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 (7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4): created successfully Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (070feed3-3b13-48f2-a897-b72d02417210) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (f356230f-fd8f-4255-9a8b-b41e9a05798d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-181cfa7e-e545-4457-9fcb-6e2a921b2cdc tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:12:03 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 1073741824" returned: 0 in 0.462s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:03 devstack sudo[105204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 Nov 05 11:12:03 devstack sudo[105204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:03 devstack sudo[105204]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9840888-be0e-49cb-9fcb-d073824b2434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad52c1b0-9e3a-4ef2-922e-478883510a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:03 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Volume volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 (3b3ec528-15c9-47b2-8e50-2e269b7b8af0): created successfully Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad52c1b0-9e3a-4ef2-922e-478883510a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Flow 'volume_create_manager' (239717ec-151a-423a-8eb1-c5e59f00f642) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-25406b4a-09ed-40dc-9ac6-d78ff5522e8a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created volume successfully. Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-3b3ec528-15c9-47b2-8e50-2e269b7b8af0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-3b3ec528-15c9-47b2-8e50-2e269b7b8af0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[92543027-ca3d-41c8-8ebd-3ba75c2482a8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:04 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 Nov 05 11:12:04 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:04 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:04 devstack sudo[105212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0 Nov 05 11:12:04 devstack sudo[105212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:04 devstack sudo[105212]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-3b3ec528-15c9-47b2-8e50-2e269b7b8af0" released by "delete_volume" :: held 0.748s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['fc4e7f3f-e0ed-4500-904c-753d67a3dcd8', '993a281f-5382-4938-acec-59233ca4e2ba', '251fa401-8ebe-486e-80bb-812f415bb3d5', '8aed777c-d7b1-46c7-822c-06a7ad2c1eb4'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:05 devstack sudo[105230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:05 devstack sudo[105230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:05 devstack sudo[105230]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.338s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff51a4f0-086c-4c3e-a9b6-32a6d909ca2a tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-3b3ec528-15c9-47b2-8e50-2e269b7b8af0-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[324366a7-994a-4b2e-bd16-ad5d203e060f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:05 devstack sudo[105236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 Nov 05 11:12:05 devstack sudo[105236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:05 devstack sudo[105236]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" returned: 0 in 0.403s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:05 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4 Nov 05 11:12:05 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:06 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" returned: 0 in 0.268s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4" released by "delete_volume" :: held 0.740s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['de498c69-a4b4-4427-9be7-d57e4bf6b53a', '4f0b8440-f6dd-452d-a7b5-5c5a79477954', 'e20e19ea-490d-4645-81e8-2debfc1c9fe9', 'aee39d8f-d71e-491e-9e02-2a932578ed4b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:06 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:06 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:06 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fd8f4bbf-4d0f-48e8-9993-4723d6dc35e5 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-7c5c209a-61b8-4f18-bf76-eb5f21c4bbc4-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b68532d-00d4-48e6-8838-56d3f2457211]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:06 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 Nov 05 11:12:06 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:07 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" returned: 0 in 0.408s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:07 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0 Nov 05 11:12:07 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:07 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0" released by "delete_volume" :: held 0.751s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['c4919be2-78c8-43eb-aa00-cd1e3684d842', '42e24bdd-52e5-456f-a70d-b2730ef17f6c', '5c4b3136-c465-4c5e-8ea3-9c67875079a2', '7decec16-63c3-4cfa-a9ab-b8c437616ced'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:07 devstack sudo[105258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:07 devstack sudo[105258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-b0cc6df6-f080-4440-90c4-8fde19c7e82b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-b0cc6df6-f080-4440-90c4-8fde19c7e82b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:07 devstack sudo[105258]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:07 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-b0cc6df6-f080-4440-90c4-8fde19c7e82b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-b0cc6df6-f080-4440-90c4-8fde19c7e82b" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c34194c3-fbe6-470b-ad5e-e1a0ca3236e0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-11984cc3-c02e-41dd-9d4a-5f11ff9d8dc0-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[60d16270-78cd-46b0-a1d9-a76c301eb679]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:07 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b Nov 05 11:12:07 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:08 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:08 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b Nov 05 11:12:08 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:08 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0cc6df6-f080-4440-90c4-8fde19c7e82b" returned: 0 in 0.235s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-b0cc6df6-f080-4440-90c4-8fde19c7e82b" released by "delete_volume" :: held 0.659s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['d5647388-bad2-4291-9847-28055cf7c7d9', 'cc27c0e6-8bbc-45df-aa82-ff5bc4f11bdb', '75018ffa-422f-40f4-870d-6edda3359567', 'd806af8d-6ecc-4f34-b526-39fdd88b486f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:08 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:08 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:08 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.249s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:08 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a1f2276-3431-41a7-ad70-aa5188117df8 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-b0cc6df6-f080-4440-90c4-8fde19c7e82b-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-c125d54a-c2e0-436c-bd97-a62f660e1a45-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-c125d54a-c2e0-436c-bd97-a62f660e1a45-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-c125d54a-c2e0-436c-bd97-a62f660e1a45" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-c125d54a-c2e0-436c-bd97-a62f660e1a45" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d01e687-3d31-49b7-bee5-29f35ab0a1f1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:09 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 Nov 05 11:12:09 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:09 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45" returned: 0 in 0.374s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:09 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45 Nov 05 11:12:09 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:09 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c125d54a-c2e0-436c-bd97-a62f660e1a45" returned: 0 in 0.282s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-c125d54a-c2e0-436c-bd97-a62f660e1a45" released by "delete_volume" :: held 0.703s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['1ef95e76-bcd9-4a4d-a693-bdccc0209f06', '2b6763ea-9bce-4893-b209-0a5928552d85', '95cf6fe9-e77d-4b53-b909-f6b4817ccd21', '744fd4f7-681c-4f54-bd97-f39e107baf51'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:09 devstack sudo[105281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:09 devstack sudo[105281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:10 devstack sudo[105281]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.297s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-745faadd-1566-40b9-88e8-5efa64302af0 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-c125d54a-c2e0-436c-bd97-a62f660e1a45-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "cinder-quobyte-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e652b86f-5a82-41a2-ad66-9c38c5f33b4d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:10 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f Nov 05 11:12:10 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:10 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:10 devstack sudo[105289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f Nov 05 11:12:10 devstack sudo[105289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:10 devstack sudo[105289]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" returned: 0 in 0.242s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-quobyte-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f" released by "delete_volume" :: held 0.655s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Created reservations ['32f80fe4-f2c9-4dfb-8d9f-612245ac9e45', '96cf32bc-a891-45cb-a9b1-22d1503ef7ba', 'dcab4811-8a05-4545-a8c1-c6f4825a5917', 'd3dbe974-093a-4871-881c-25c171dbc132'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:11 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:11 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:11 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Deleted volume successfully. Nov 05 11:12:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3478533a-342b-489f-96f5-adbec22f8760 tempest-CreateVolumesFromSourceVolumeTest-348452841 None] Lock "cinder-cca2bcd5-8e1c-4eb4-b1d5-a4e70b04cd8f-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Flow 'volume_create_manager' (f9f27f44-c486-4fec-8744-02c50c7b9e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062371af-8345-4b9c-9dfc-53dae4a0e5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (062371af-8345-4b9c-9dfc-53dae4a0e5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e7079e-a564-4d2d-9614-5cd982a70d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc498e0a15245dab93b67c24093babd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:14Z,use_quota=True,user_id='ef3fa69bd8954240aeb4fb22be6f241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9076a92a-8034-42e5-949d-aa254afbc801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9076a92a-8034-42e5-949d-aa254afbc801) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9d582a-763c-4f78-bf8c-613f7d382d08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a9d582a-763c-4f78-bf8c-613f7d382d08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1e7079e-a564-4d2d-9614-5cd982a70d5f', 'volume_name': 'volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5154c8ec-f42d-4dcd-8dd1-ed6995936d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5154c8ec-f42d-4dcd-8dd1-ed6995936d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced04f8-86d0-457b-86bf-48604e3c7f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:14 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Volume f1e7079e-a564-4d2d-9614-5cd982a70d5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f', 'volume_size': 1} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1e7079e-a564-4d2d-9614-5cd982a70d5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc498e0a15245dab93b67c24093babd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:14Z,use_quota=True,user_id='ef3fa69bd8954240aeb4fb22be6f241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Creating volume f1e7079e-a564-4d2d-9614-5cd982a70d5f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:14 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:14 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f 1073741824 Nov 05 11:12:14 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:14 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f 1073741824" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:14 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f Nov 05 11:12:14 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:15 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f" returned: 0 in 0.267s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ced04f8-86d0-457b-86bf-48604e3c7f7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560a68c1-cdc9-4347-9f5b-5646310015b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:15 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Volume volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f (f1e7079e-a564-4d2d-9614-5cd982a70d5f): created successfully Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (560a68c1-cdc9-4347-9f5b-5646310015b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:15 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Flow 'volume_create_manager' (f9f27f44-c486-4fec-8744-02c50c7b9e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c7ea66f3-a3d5-434a-8692-a0d91b17767d tempest-CinderUnicodeTest-801241309 None] Created volume successfully. Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Flow 'volume_create_manager' (db49f5f0-7368-43b1-9729-172a23944211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240ad280-8773-443d-90e9-90b694220a9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (240ad280-8773-443d-90e9-90b694220a9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-786613692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d0c0d-c056-4f01-bf8e-5e4070c5049b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc498e0a15245dab93b67c24093babd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:17Z,use_quota=True,user_id='ef3fa69bd8954240aeb4fb22be6f241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4cba70-6de4-466e-8d5a-0c5614c555cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed4cba70-6de4-466e-8d5a-0c5614c555cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5baf83f-c071-4a2c-a1aa-3b4188782072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5baf83f-c071-4a2c-a1aa-3b4188782072) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a85d0c0d-c056-4f01-bf8e-5e4070c5049b', 'volume_name': 'volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5443658b-6779-422a-8afa-60df73d20819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5443658b-6779-422a-8afa-60df73d20819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf75bad-3752-4b5f-9f55-d204c9962730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:17 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Volume a85d0c0d-c056-4f01-bf8e-5e4070c5049b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b', 'volume_size': 1} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-786613692',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a85d0c0d-c056-4f01-bf8e-5e4070c5049b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9cc498e0a15245dab93b67c24093babd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:17Z,use_quota=True,user_id='ef3fa69bd8954240aeb4fb22be6f241e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Creating volume a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:17 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:17 devstack sudo[105307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b 1073741824 Nov 05 11:12:17 devstack sudo[105307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:17 devstack sudo[105307]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b 1073741824" returned: 0 in 0.536s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:17 devstack sudo[105316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b Nov 05 11:12:17 devstack sudo[105316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:18 devstack sudo[105316]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" returned: 0 in 0.330s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] <== create_volume: return (912ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (baf75bad-3752-4b5f-9f55-d204c9962730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba2c4b-224a-4b47-9dab-d5bccc1ccb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Volume volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b (a85d0c0d-c056-4f01-bf8e-5e4070c5049b): created successfully Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ba2c4b-224a-4b47-9dab-d5bccc1ccb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Flow 'volume_create_manager' (db49f5f0-7368-43b1-9729-172a23944211) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-16ad7449-3946-4c20-ac6b-2c582b0a5ce4 tempest-CinderUnicodeTest-801241309 None] Created volume successfully. Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-e03a9483-64a9-4f39-8a74-06774c44cf53 req-247b905a-1ba0-437c-a213-3d2757528db1 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-e03a9483-64a9-4f39-8a74-06774c44cf53 req-247b905a-1ba0-437c-a213-3d2757528db1 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-e03a9483-64a9-4f39-8a74-06774c44cf53 req-247b905a-1ba0-437c-a213-3d2757528db1 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-e03a9483-64a9-4f39-8a74-06774c44cf53 req-247b905a-1ba0-437c-a213-3d2757528db1 tempest-TestServerVolumeAttachmentScenario-501465879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-043afb71-6306-449e-bcec-8cdf70ac46f1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a7b611e1-e6d0-49c1-b5a7-08691df7c65a', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:12:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-e03a9483-64a9-4f39-8a74-06774c44cf53 req-247b905a-1ba0-437c-a213-3d2757528db1 tempest-TestServerVolumeAttachmentScenario-501465879 None] attachment_update completed successfully. Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Creating offline snapshot 5a83a1cf-0871-4b46-8ce8-a48b82daadd0 of volume a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d132263-d065-4248-b894-6d0302c8b067]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:19 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b Nov 05 11:12:19 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:19 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:19 devstack sudo[105748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 1G Nov 05 11:12:19 devstack sudo[105748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:20 devstack sudo[105748]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 1G" returned: 0 in 0.459s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:20 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 Nov 05 11:12:20 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:20 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:20 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 is being set with open permissions: ugo+rw Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:20 devstack sudo[105759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 Nov 05 11:12:20 devstack sudo[105759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:20 devstack sudo[105759]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0" returned: 0 in 0.260s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:20 devstack sudo[105762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info Nov 05 11:12:20 devstack sudo[105762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:21 devstack sudo[105762]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:21 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info is being set with open permissions: ugo+rw Nov 05 11:12:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:21 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info Nov 05 11:12:21 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:21 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.info" returned: 0 in 0.268s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.094s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e1e76ab2-9389-4a0f-bf74-bd8e2d490e79 tempest-CinderUnicodeTest-801241309 None] Create snapshot completed successfully Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-5a83a1cf-0871-4b46-8ce8-a48b82daadd0-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-5a83a1cf-0871-4b46-8ce8-a48b82daadd0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-quobyte-5a83a1cf-0871-4b46-8ce8-a48b82daadd0" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-5a83a1cf-0871-4b46-8ce8-a48b82daadd0" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Deleting offline snapshot 5a83a1cf-0871-4b46-8ce8-a48b82daadd0 of volume a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] snapshot_file for this snap is: volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4744346e-5eca-4d17-a467-b67b3a535859]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:22 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 Nov 05 11:12:22 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a3563129-bf24-48b4-bc0b-19b2bf25205a req-aa16580a-aa6b-4302-b0b8-e6fa5fb52f78 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a3563129-bf24-48b4-bc0b-19b2bf25205a req-aa16580a-aa6b-4302-b0b8-e6fa5fb52f78 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [req-a3563129-bf24-48b4-bc0b-19b2bf25205a req-aa16580a-aa6b-4302-b0b8-e6fa5fb52f78 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-a3563129-bf24-48b4-bc0b-19b2bf25205a req-aa16580a-aa6b-4302-b0b8-e6fa5fb52f78 tempest-TestServerVolumeAttachmentScenario-501465879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb', 'name': 'volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '720ebec3-be5b-48da-ac28-834b40a2d46a', 'enforce_multipath': True} {{(pid=87369) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 05 11:12:23 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-a3563129-bf24-48b4-bc0b-19b2bf25205a req-aa16580a-aa6b-4302-b0b8-e6fa5fb52f78 tempest-TestServerVolumeAttachmentScenario-501465879 None] attachment_update completed successfully. Nov 05 11:12:23 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f817c464-2ee2-440a-80b9-54df1af08e3e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:23 devstack sudo[105786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b Nov 05 11:12:23 devstack sudo[105786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:23 devstack sudo[105786]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" returned: 0 in 0.461s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:23 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 Nov 05 11:12:23 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:24 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:24 devstack sudo[105797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0 Nov 05 11:12:24 devstack sudo[105797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:24 devstack sudo[105797]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b.5a83a1cf-0871-4b46-8ce8-a48b82daadd0" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-5a83a1cf-0871-4b46-8ce8-a48b82daadd0" released by "_delete_snapshot" :: held 1.711s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" released by "delete_snapshot" :: held 1.744s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Created reservations ['bfc0926f-2ab7-486e-b480-9126585adb47', 'b5ea983c-f2da-4649-ba46-750be8c47dd0', '4722129e-7cde-4ccc-a2ab-85cf442154f2', 'e2bbd619-f3a5-4ad9-b753-8025fd02e0c3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Delete snapshot completed successfully. Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-e78d719c-09e8-451c-a1c6-15d9147a897e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-5a83a1cf-0871-4b46-8ce8-a48b82daadd0-delete_snapshot" released by "delete_snapshot" :: held 1.900s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-e5098c2f-a6c1-45cd-8595-bbb8b3ce774b req-26c8a063-9154-4d30-bd26-11776cf8aea6 tempest-TestServerVolumeAttachmentScenario-501465879 None] Terminate volume connection completed successfully. Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-e5098c2f-a6c1-45cd-8595-bbb8b3ce774b req-26c8a063-9154-4d30-bd26-11776cf8aea6 tempest-TestServerVolumeAttachmentScenario-501465879 None] Deleting attachment 720ebec3-be5b-48da-ac28-834b40a2d46a. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-a85d0c0d-c056-4f01-bf8e-5e4070c5049b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-a85d0c0d-c056-4f01-bf8e-5e4070c5049b-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[44bf3395-fd39-4cdf-a485-522cfb7c09e4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:25 devstack sudo[105802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b Nov 05 11:12:25 devstack sudo[105802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:25 devstack sudo[105802]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" returned: 0 in 0.353s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:25 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b Nov 05 11:12:25 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:25 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" returned: 0 in 0.262s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-a85d0c0d-c056-4f01-bf8e-5e4070c5049b" released by "delete_volume" :: held 0.676s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Created reservations ['bdc5d195-20a6-43d1-a469-32b1c7d49599', '68c559fe-1e0a-49d8-a9a1-48bee1d7a888', '983b5f85-06f1-4331-af33-bcdab7bf7af6', '931338a2-a001-4c66-bd9c-fc091c3464e7'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:25 devstack sudo[105810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:25 devstack sudo[105810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:26 devstack sudo[105810]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.280s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-f1e7079e-a564-4d2d-9614-5cd982a70d5f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Deleted volume successfully. Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "cinder-f1e7079e-a564-4d2d-9614-5cd982a70d5f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3646f5ed-0936-48b7-abb2-6392601a1e1e tempest-CinderUnicodeTest-801241309 None] Lock "cinder-a85d0c0d-c056-4f01-bf8e-5e4070c5049b-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "cinder-quobyte-f1e7079e-a564-4d2d-9614-5cd982a70d5f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-f1e7079e-a564-4d2d-9614-5cd982a70d5f" acquired by "delete_volume" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[eddd516e-0329-4261-a341-e28966ca93f9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [req-66430c11-64a7-4ad6-be78-6aeda5beaf02 req-678410ab-acaa-4702-8e57-710cc20b1ffb tempest-TestServerVolumeAttachmentScenario-501465879 None] Terminate volume connection completed successfully. Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [req-66430c11-64a7-4ad6-be78-6aeda5beaf02 req-678410ab-acaa-4702-8e57-710cc20b1ffb tempest-TestServerVolumeAttachmentScenario-501465879 None] Deleting attachment a7b611e1-e6d0-49c1-b5a7-08691df7c65a. {{(pid=87369) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5054}} Nov 05 11:12:26 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f Nov 05 11:12:26 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:26 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f" returned: 0 in 0.432s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:26 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f Nov 05 11:12:26 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:26 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f1e7079e-a564-4d2d-9614-5cd982a70d5f" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "cinder-quobyte-f1e7079e-a564-4d2d-9614-5cd982a70d5f" released by "delete_volume" :: held 0.751s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:26 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Created reservations ['c1f6361d-9698-40b1-a1b7-c619267ae6fc', '9d0d7f96-bf51-4f9f-9d06-82905fce8999', 'a1638dbd-b927-4e2d-9e00-fbf5dcac8ca4', 'c9636015-ff13-4474-8ffd-03c36cf61d05'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:27 devstack sudo[105850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:27 devstack sudo[105850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:27 devstack sudo[105850]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.376s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:27 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Deleted volume successfully. Nov 05 11:12:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b7c28f4b-44d1-427f-abbb-c298ff849d58 tempest-CinderUnicodeTest-801241309 None] Lock "cinder-f1e7079e-a564-4d2d-9614-5cd982a70d5f-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "cinder-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "cinder-quobyte-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-quobyte-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[aad855cd-edc4-4202-96ff-96403f5685f1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:31 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d Nov 05 11:12:31 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:31 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:31 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d Nov 05 11:12:31 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:32 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" returned: 0 in 0.319s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-quobyte-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d" released by "delete_volume" :: held 0.786s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Created reservations ['9e338a02-fcf3-44e5-9659-c4e9702a93d0', '5d2c4429-2424-405e-ae3d-c8327aad7784', '2d283a18-ead1-47fe-a479-acfe615e2908', '959af5ce-c4d7-479a-8907-481a0c526d25'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=134,cinder:UPDATE=152,cinder:DELETE=15,cinder:INSERT=35 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:32 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:32 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "cinder-043afb71-6306-449e-bcec-8cdf70ac46f1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-043afb71-6306-449e-bcec-8cdf70ac46f1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=180,cinder:SELECT=114,cinder:INSERT=41,cinder:DELETE=14 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "cinder-quobyte-043afb71-6306-449e-bcec-8cdf70ac46f1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-quobyte-043afb71-6306-449e-bcec-8cdf70ac46f1" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:32 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.321s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Deleted volume successfully. Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f242d9dc-2168-4051-ac9c-5c28b991d2e3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1a416083-647b-4161-ab2d-49eda361f2be tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-af2f6c0b-ae9f-4a8b-9e85-cf83bf88c25d-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:32 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 Nov 05 11:12:32 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:33 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1" returned: 0 in 0.502s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:33 devstack sudo[105932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1 Nov 05 11:12:33 devstack sudo[105932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:33 devstack sudo[105932]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-043afb71-6306-449e-bcec-8cdf70ac46f1" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-quobyte-043afb71-6306-449e-bcec-8cdf70ac46f1" released by "delete_volume" :: held 0.856s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Created reservations ['811a50e2-6289-4c8e-9f0f-161eda9db0fe', '629f1752-169b-4f6f-a980-b7407be67da1', 'b01efd09-406e-4f88-b447-82a9dd012f9f', '12c068d7-b51f-4e9f-aac2-1309fc7fcba6'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:33 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:33 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:33 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.323s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:33 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Deleted volume successfully. Nov 05 11:12:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-0e0363dc-48a0-4f1f-88a2-0176382bb5d7 tempest-TestServerVolumeAttachmentScenario-501465879 None] Lock "cinder-043afb71-6306-449e-bcec-8cdf70ac46f1-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:43 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:DELETE=1,cinder:SELECT=2,cinder:INSERT=2,cinder:UPDATE=10 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:12:43 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=8,cinder:SELECT=8,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (d37a6f87-211a-4987-be86-b99798d5f84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb9ffa4-83a1-4e7e-bde1-df0bb8ce853b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb9ffa4-83a1-4e7e-bde1-df0bb8ce853b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223913982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ee9ae-aa4b-4d06-b257-5c08fc93590a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:46Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0429372-3d8f-4765-942d-d8415a66f3ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0429372-3d8f-4765-942d-d8415a66f3ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821c5edd-d90d-4ed1-92cf-02eee113aa0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (821c5edd-d90d-4ed1-92cf-02eee113aa0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c9ee9ae-aa4b-4d06-b257-5c08fc93590a', 'volume_name': 'volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb944d51-5d7b-4a52-a8b5-eb1e431d4503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb944d51-5d7b-4a52-a8b5-eb1e431d4503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f79710a-83a4-47b3-aa0e-de854d240289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:46 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 4c9ee9ae-aa4b-4d06-b257-5c08fc93590a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a', 'volume_size': 1} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1223913982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c9ee9ae-aa4b-4d06-b257-5c08fc93590a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:46Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:46 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:46 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a 1073741824 Nov 05 11:12:46 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:46 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a 1073741824" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:46 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a Nov 05 11:12:46 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:47 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" returned: 0 in 0.251s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (701ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f79710a-83a4-47b3-aa0e-de854d240289) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962e566b-2ab2-4042-aa5e-ac8a86d3e663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:47 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a (4c9ee9ae-aa4b-4d06-b257-5c08fc93590a): created successfully Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962e566b-2ab2-4042-aa5e-ac8a86d3e663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (d37a6f87-211a-4987-be86-b99798d5f84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-97497c1a-d951-4d67-8210-fc26937d5dd6 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating offline snapshot b76f94c1-13ee-4b5e-84ea-e7db609260cc of volume 4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c23f44d-a9ac-47d5-9bc8-1bf84ed2fd06]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:47 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a Nov 05 11:12:47 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:47 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" returned: 0 in 0.365s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:47 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc 1G Nov 05 11:12:47 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:48 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc 1G" returned: 0 in 0.389s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:48 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc Nov 05 11:12:48 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:48 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:48 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc is being set with open permissions: ugo+rw Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:48 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc Nov 05 11:12:48 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:48 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc" returned: 0 in 0.248s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:48 devstack sudo[105974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info Nov 05 11:12:48 devstack sudo[105974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:49 devstack sudo[105974]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info" returned: 0 in 0.265s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:49 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info is being set with open permissions: ugo+rw Nov 05 11:12:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:49 devstack sudo[105977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info Nov 05 11:12:49 devstack sudo[105977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:49 devstack sudo[105977]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.info" returned: 0 in 0.248s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-8bc1c307-f0a2-4cf9-84bd-b6fd80780b90 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Create snapshot completed successfully Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (1be6c655-d9ac-4669-a982-cb07263e3af0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5981d52-8771-49e5-8719-57fdb40b49ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5981d52-8771-49e5-8719-57fdb40b49ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690705170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bca917c-d7d7-442d-9986-d472f98e47d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:50Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836f37c1-821d-4034-b029-2aec3f0b1384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (836f37c1-821d-4034-b029-2aec3f0b1384) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baf26d-a330-42c7-bddf-628b2da4308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54baf26d-a330-42c7-bddf-628b2da4308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bca917c-d7d7-442d-9986-d472f98e47d8', 'volume_name': 'volume-3bca917c-d7d7-442d-9986-d472f98e47d8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561cafc0-75f5-4e01-9cdd-3b5be7d65ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (561cafc0-75f5-4e01-9cdd-3b5be7d65ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50f68c3-aa0a-4a13-b860-bb1263e5f1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 3bca917c-d7d7-442d-9986-d472f98e47d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bca917c-d7d7-442d-9986-d472f98e47d8', 'volume_size': 1} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-690705170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bca917c-d7d7-442d-9986-d472f98e47d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:50Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 3bca917c-d7d7-442d-9986-d472f98e47d8 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:50 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:50 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 1073741824 Nov 05 11:12:50 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:50 devstack sudo[105981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:50 devstack sudo[105981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:50 devstack sudo[105981]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (f7535a88-60c4-4c1e-8093-4dea01198185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9560118-14f3-41f7-8f74-c163cad48c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9560118-14f3-41f7-8f74-c163cad48c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408373340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed40bb8-1745-4df3-af69-6ba0a30d8419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:51Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bdd331-7a76-4b9c-a627-b57ef4160c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bdd331-7a76-4b9c-a627-b57ef4160c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1cd051-e5cb-430d-a5c2-10b40fb8e232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea1cd051-e5cb-430d-a5c2-10b40fb8e232) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ed40bb8-1745-4df3-af69-6ba0a30d8419', 'volume_name': 'volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b7449-4bef-4711-a308-65f61d76badb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (182b7449-4bef-4711-a308-65f61d76badb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a046441-d94e-47c4-ace1-f7db2d3853ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 6ed40bb8-1745-4df3-af69-6ba0a30d8419: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419', 'volume_size': 1} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:50 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 1073741824" returned: 0 in 0.656s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:50 devstack sudo[105989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 Nov 05 11:12:50 devstack sudo[105989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (8fd9a3f3-4a19-4805-a5f5-a68f9320deca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1081ec0f-d234-4f59-8129-553d1a242129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1081ec0f-d234-4f59-8129-553d1a242129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162603771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3249ca16-da7d-43cf-8f19-4b07aed2d1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:51Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eecec74-aac3-4077-b692-97c13dc7f510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1eecec74-aac3-4077-b692-97c13dc7f510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bd2dc8-4fb3-499f-b64c-992045fb33e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02bd2dc8-4fb3-499f-b64c-992045fb33e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3249ca16-da7d-43cf-8f19-4b07aed2d1f3', 'volume_name': 'volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6c0b23-94b4-42db-9159-3f9cf9165e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e6c0b23-94b4-42db-9159-3f9cf9165e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848d8c1-53a9-4320-964f-cc2c149895a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 3249ca16-da7d-43cf-8f19-4b07aed2d1f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3', 'volume_size': 1} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:51 devstack sudo[105989]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.480s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1408373340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ed40bb8-1745-4df3-af69-6ba0a30d8419,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:51Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 6ed40bb8-1745-4df3-af69-6ba0a30d8419 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:51 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f50f68c3-aa0a-4a13-b860-bb1263e5f1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bca917c-d7d7-442d-9986-d472f98e47d8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 1073741824 Nov 05 11:12:51 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101f9918-4d9c-4d8f-8e4c-72555dec504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-3bca917c-d7d7-442d-9986-d472f98e47d8 (3bca917c-d7d7-442d-9986-d472f98e47d8): created successfully Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (101f9918-4d9c-4d8f-8e4c-72555dec504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (1be6c655-d9ac-4669-a982-cb07263e3af0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b331d1d6-cda9-4e10-8069-6f37cbf20ba8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (de10b01e-0290-456b-98e7-7d0d133988ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafc7d3-8ef4-43f8-956b-d04b10dbbfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cafc7d3-8ef4-43f8-956b-d04b10dbbfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-522146023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da759f1-42a6-4b77-aab9-38689fb1e698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:52Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de472b8-fecd-46e2-8e52-9858daf07df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4de472b8-fecd-46e2-8e52-9858daf07df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9e30e-e8d0-494a-8970-dcd9720aa568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d9e30e-e8d0-494a-8970-dcd9720aa568) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1da759f1-42a6-4b77-aab9-38689fb1e698', 'volume_name': 'volume-1da759f1-42a6-4b77-aab9-38689fb1e698', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57812a5-61fc-47aa-a3d5-31a4783aa706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e57812a5-61fc-47aa-a3d5-31a4783aa706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d4955-1c1e-4bf3-86c5-d4519b079168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 1da759f1-42a6-4b77-aab9-38689fb1e698: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1da759f1-42a6-4b77-aab9-38689fb1e698', 'volume_size': 1} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:51 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 1073741824" returned: 0 in 0.538s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:51 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 Nov 05 11:12:51 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (c4667317-80d3-46ec-8bce-c6930c70e110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6614b617-83f1-4523-a2c7-b9b1291b2b35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6614b617-83f1-4523-a2c7-b9b1291b2b35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799327513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a93bc1a-4231-491d-9518-2e00aa200421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:52Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd52cb2-86eb-4d02-b9ed-940b53c916d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd52cb2-86eb-4d02-b9ed-940b53c916d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e379bffa-bd70-4c7e-9d5a-914263639e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e379bffa-bd70-4c7e-9d5a-914263639e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a93bc1a-4231-491d-9518-2e00aa200421', 'volume_name': 'volume-8a93bc1a-4231-491d-9518-2e00aa200421', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc9f8a8-d00b-426e-a2bc-40ac3344c28c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc9f8a8-d00b-426e-a2bc-40ac3344c28c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67634f7c-3ab2-4012-8b26-dcbe4eaa8278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume 8a93bc1a-4231-491d-9518-2e00aa200421: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a93bc1a-4231-491d-9518-2e00aa200421', 'volume_size': 1} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:52 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.936s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1162603771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3249ca16-da7d-43cf-8f19-4b07aed2d1f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:51Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 3249ca16-da7d-43cf-8f19-4b07aed2d1f3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a046441-d94e-47c4-ace1-f7db2d3853ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack sudo[106001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 1073741824 Nov 05 11:12:52 devstack sudo[106001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcca3e0-2def-4dea-843b-42559aead981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 (6ed40bb8-1745-4df3-af69-6ba0a30d8419): created successfully Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbcca3e0-2def-4dea-843b-42559aead981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (f7535a88-60c4-4c1e-8093-4dea01198185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5e57f779-e38b-46b8-9cb6-f1876e6390a5 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:52 devstack sudo[106001]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 1073741824" returned: 0 in 0.427s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:52 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 Nov 05 11:12:52 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:52 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" returned: 0 in 0.264s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.213s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-522146023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1da759f1-42a6-4b77-aab9-38689fb1e698,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:52Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 1da759f1-42a6-4b77-aab9-38689fb1e698 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848d8c1-53a9-4320-964f-cc2c149895a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29db0edf-1a08-48bb-8fc6-8b9a30227db2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:52 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 1073741824 Nov 05 11:12:52 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 (3249ca16-da7d-43cf-8f19-4b07aed2d1f3): created successfully Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29db0edf-1a08-48bb-8fc6-8b9a30227db2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (8fd9a3f3-4a19-4805-a5f5-a68f9320deca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-406d07a9-cb62-4c94-a870-07392512c41a tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:53 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 1073741824" returned: 0 in 0.480s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:53 devstack sudo[106016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 Nov 05 11:12:53 devstack sudo[106016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:53 devstack sudo[106016]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698" returned: 0 in 0.249s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.557s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:12:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-799327513',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a93bc1a-4231-491d-9518-2e00aa200421,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='acdf60e355f24d3b856b6184cb618b02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:12:52Z,use_quota=True,user_id='dc8ebd0f1f5c470aa9b45d2840c08f2c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Creating volume 8a93bc1a-4231-491d-9518-2e00aa200421 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:12:53 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed1d4955-1c1e-4bf3-86c5-d4519b079168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1da759f1-42a6-4b77-aab9-38689fb1e698', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef8168c-2607-4290-a55f-cc30ddfd871a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:53 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 1073741824 Nov 05 11:12:53 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-1da759f1-42a6-4b77-aab9-38689fb1e698 (1da759f1-42a6-4b77-aab9-38689fb1e698): created successfully Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ef8168c-2607-4290-a55f-cc30ddfd871a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (de10b01e-0290-456b-98e7-7d0d133988ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4c624db4-7bb7-4530-a2f4-17bfd8fdbec8 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:54 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 1073741824" returned: 0 in 0.511s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:54 devstack sudo[106025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 Nov 05 11:12:54 devstack sudo[106025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:54 devstack sudo[106025]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] <== create_volume: return (849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67634f7c-3ab2-4012-8b26-dcbe4eaa8278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a93bc1a-4231-491d-9518-2e00aa200421', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a11a04c-0714-41c2-bf85-0cce23d16a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:12:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Volume volume-8a93bc1a-4231-491d-9518-2e00aa200421 (8a93bc1a-4231-491d-9518-2e00aa200421): created successfully Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a11a04c-0714-41c2-bf85-0cce23d16a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:12:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Flow 'volume_create_manager' (c4667317-80d3-46ec-8bce-c6930c70e110) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:12:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-606114c5-5cce-4411-a9ba-1f39bf498dcd tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created volume successfully. Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-8a93bc1a-4231-491d-9518-2e00aa200421-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-8a93bc1a-4231-491d-9518-2e00aa200421-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-8a93bc1a-4231-491d-9518-2e00aa200421" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-8a93bc1a-4231-491d-9518-2e00aa200421" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6c4878-23fa-48e6-b657-014fc36c8914]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:55 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 Nov 05 11:12:55 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:56 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:56 devstack sudo[106033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421 Nov 05 11:12:56 devstack sudo[106033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:56 devstack sudo[106033]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a93bc1a-4231-491d-9518-2e00aa200421" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-8a93bc1a-4231-491d-9518-2e00aa200421" released by "delete_volume" :: held 0.782s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['92b2d546-ed75-4455-a625-609729785d81', '2e4453c2-ae17-42c8-a5a4-c03c5bfecf1c', '565e8d5c-4dde-4793-a931-54b1e1c8137a', 'ca70e9b1-f244-4019-8006-7542b2019b0d'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:56 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:56 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-1da759f1-42a6-4b77-aab9-38689fb1e698-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-1da759f1-42a6-4b77-aab9-38689fb1e698-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-1da759f1-42a6-4b77-aab9-38689fb1e698" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-1da759f1-42a6-4b77-aab9-38689fb1e698" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:56 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.349s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9d3c5e-88e9-4f06-925c-71fffc366d7e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d1bcb64-2e36-416d-9e27-e5f266f639a7 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-8a93bc1a-4231-491d-9518-2e00aa200421-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:57 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 Nov 05 11:12:57 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:57 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698" returned: 0 in 0.407s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:57 devstack sudo[106044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698 Nov 05 11:12:57 devstack sudo[106044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:57 devstack sudo[106044]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1da759f1-42a6-4b77-aab9-38689fb1e698" returned: 0 in 0.270s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-1da759f1-42a6-4b77-aab9-38689fb1e698" released by "delete_volume" :: held 0.738s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['f6c1c933-0b0a-4174-9baa-b776b5c545d5', '1e395275-5f32-4877-aeed-916d166e6741', '2b54f21b-0377-4cfd-a4d2-18fc70d9c92f', '5103f121-2a81-4457-97d5-600870b5b1c7'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:57 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:57 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-3249ca16-da7d-43cf-8f19-4b07aed2d1f3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-3249ca16-da7d-43cf-8f19-4b07aed2d1f3-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:58 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d10e80ef-ee1a-4ea0-9f1a-0f0fd07c4502 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-1da759f1-42a6-4b77-aab9-38689fb1e698-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab43c96e-26f6-40db-b362-fafa3bb935e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:58 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 Nov 05 11:12:58 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:58 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" returned: 0 in 0.352s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:58 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3 Nov 05 11:12:58 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:58 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" returned: 0 in 0.242s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-3249ca16-da7d-43cf-8f19-4b07aed2d1f3" released by "delete_volume" :: held 0.648s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['273c0b44-c89e-4029-89c3-212e9e929c23', 'a1139145-8bef-4cbb-ac7b-1fe6e492735e', '2e777e7d-2758-4591-bfbe-1618139d91cd', 'd36734fb-5899-41e4-ada1-6483741b4671'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:12:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:58 devstack sudo[106059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:12:58 devstack sudo[106059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:59 devstack sudo[106059]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.235s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:12:59 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74e5d16e-fb9c-4e00-b9b5-653cf36c4a78 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-3249ca16-da7d-43cf-8f19-4b07aed2d1f3-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-6ed40bb8-1745-4df3-af69-6ba0a30d8419-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-6ed40bb8-1745-4df3-af69-6ba0a30d8419-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-6ed40bb8-1745-4df3-af69-6ba0a30d8419" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-6ed40bb8-1745-4df3-af69-6ba0a30d8419" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b02f09-18a4-4268-bda8-f6a5ad067926]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:59 devstack sudo[106062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 Nov 05 11:12:59 devstack sudo[106062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:59 devstack sudo[106062]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:12:59 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419 Nov 05 11:12:59 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:12:59 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-6ed40bb8-1745-4df3-af69-6ba0a30d8419" returned: 0 in 0.241s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-6ed40bb8-1745-4df3-af69-6ba0a30d8419" released by "delete_volume" :: held 0.667s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:12:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['0e4a35f4-7982-4b15-b482-7e20325b9596', '1e68a297-792a-4e3b-98c6-fd15e8ad12b1', 'bbc2a593-1e03-4f39-831c-81e7e2f0346e', 'be2b3dad-c9af-4b9e-a32c-325e87df0fe2'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:00 devstack sudo[106070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:00 devstack sudo[106070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:00 devstack sudo[106070]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-af901f14-8e46-4a38-8ac4-198e8cca8fd1 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-6ed40bb8-1745-4df3-af69-6ba0a30d8419-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-3bca917c-d7d7-442d-9986-d472f98e47d8-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-3bca917c-d7d7-442d-9986-d472f98e47d8-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-3bca917c-d7d7-442d-9986-d472f98e47d8" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-3bca917c-d7d7-442d-9986-d472f98e47d8" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b22368f5-bd22-46f0-9be2-4251bd981a28]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:00 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 Nov 05 11:13:00 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:00 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8" returned: 0 in 0.396s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:00 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8 Nov 05 11:13:00 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:01 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3bca917c-d7d7-442d-9986-d472f98e47d8" returned: 0 in 0.265s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-3bca917c-d7d7-442d-9986-d472f98e47d8" released by "delete_volume" :: held 0.706s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['1ef77f41-28fa-4635-a3d2-9c231632cf84', 'c98de181-cd5c-4396-b345-c6695450d65f', '2e98f107-078e-44ec-bfc5-5e10a72d5033', 'ff87abd7-facc-403d-b6b9-87d003a025ce'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:01 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:01 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-b76f94c1-13ee-4b5e-84ea-e7db609260cc-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:01 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-b76f94c1-13ee-4b5e-84ea-e7db609260cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-b76f94c1-13ee-4b5e-84ea-e7db609260cc" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-058ee616-fc10-4663-b5a3-782b7969d191 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-3bca917c-d7d7-442d-9986-d472f98e47d8-delete_volume" released by "delete_volume" :: held 1.238s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-b76f94c1-13ee-4b5e-84ea-e7db609260cc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleting offline snapshot b76f94c1-13ee-4b5e-84ea-e7db609260cc of volume 4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] snapshot_file for this snap is: volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b18e040-1ec7-4680-96e4-590e288e8756]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:01 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc Nov 05 11:13:01 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:02 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb3c62d3-12f5-4607-b487-f692d4c07055]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:02 devstack sudo[106089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a Nov 05 11:13:02 devstack sudo[106089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:02 devstack sudo[106089]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" returned: 0 in 0.405s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:02 devstack sudo[106094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc Nov 05 11:13:02 devstack sudo[106094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:02 devstack sudo[106094]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc" returned: 0 in 0.388s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:02 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc Nov 05 11:13:02 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:03 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a.b76f94c1-13ee-4b5e-84ea-e7db609260cc" returned: 0 in 0.287s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-b76f94c1-13ee-4b5e-84ea-e7db609260cc" released by "_delete_snapshot" :: held 1.638s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" released by "delete_snapshot" :: held 1.668s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['465ed657-1497-4153-940c-64bad15f9512', 'f2823bec-d51c-48be-b293-e56447ce0ddf', '337ca65a-ba6c-478c-9003-cd16e7e4891c', '2b4e8c94-faed-49e3-bc52-85ac59839a96'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Delete snapshot completed successfully. Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94626c30-1097-43e5-b8e2-20b8de39bcc2 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-b76f94c1-13ee-4b5e-84ea-e7db609260cc-delete_snapshot" released by "delete_snapshot" :: held 1.810s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b49d90-0a60-45f9-b80e-aa9df005dc15]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:03 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a Nov 05 11:13:03 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:04 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" returned: 0 in 0.363s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:04 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a Nov 05 11:13:04 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:04 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-quobyte-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a" released by "delete_volume" :: held 0.717s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Created reservations ['b39db794-4c36-4cd6-a4a1-203197e5ec33', 'f6ef0034-02e6-4903-b2b1-4453259d12a8', 'b7ba540c-51df-47f4-b4d3-d8ad0a60de52', '554a75a4-b33c-4d15-8115-a9984cfe7358'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:04 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:04 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:04 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Deleted volume successfully. Nov 05 11:13:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fea9fd29-d613-4957-bef4-d58f2ec63a19 tempest-CreateVolumesFromSnapshotTest-1119175661 None] Lock "cinder-4c9ee9ae-aa4b-4d06-b257-5c08fc93590a-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:14 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=52,cinder:UPDATE=63,cinder:DELETE=2,cinder:INSERT=16 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:13:14 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=50,cinder:UPDATE=83,cinder:INSERT=19,cinder:DELETE=11 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (c0e8189c-49f9-4d4b-b4fb-eaecc566a84f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea59b515-87da-4f9d-a811-947786916e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea59b515-87da-4f9d-a811-947786916e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739053269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff7ff46-a561-4775-82fc-db09078e35c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:22Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a1c0eb-055b-4158-9744-b4b40e21e05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (05a1c0eb-055b-4158-9744-b4b40e21e05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e22ee5-f32d-4c1b-9b02-86aab24edb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78e22ee5-f32d-4c1b-9b02-86aab24edb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ff7ff46-a561-4775-82fc-db09078e35c3', 'volume_name': 'volume-0ff7ff46-a561-4775-82fc-db09078e35c3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f909297-1d03-445b-952e-70255893b028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f909297-1d03-445b-952e-70255893b028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020793be-551f-4c78-ac17-066bdabbef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:22 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume 0ff7ff46-a561-4775-82fc-db09078e35c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ff7ff46-a561-4775-82fc-db09078e35c3', 'volume_size': 1} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1739053269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ff7ff46-a561-4775-82fc-db09078e35c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:22Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume 0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:22 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:22 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 1073741824 Nov 05 11:13:22 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:22 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 1073741824" returned: 0 in 0.612s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Flow 'volume_create_manager' (e2201f82-0bd3-462e-b679-22132cea0502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570a827-3fb2-4caf-a284-8e6d3f26f836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b570a827-3fb2-4caf-a284-8e6d3f26f836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464443933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df159a4b-8916-4fd9-8fc9-db13df920188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db63a868af94407385877c4c24eac83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:23Z,use_quota=True,user_id='d44cf8d26c1e46d9864541ab347e4a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6182554d-fb02-4bfa-abf4-42ae08a14f0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 Nov 05 11:13:23 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6182554d-fb02-4bfa-abf4-42ae08a14f0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4203a90f-f6aa-4e5e-a75a-157ed680f785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4203a90f-f6aa-4e5e-a75a-157ed680f785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df159a4b-8916-4fd9-8fc9-db13df920188', 'volume_name': 'volume-df159a4b-8916-4fd9-8fc9-db13df920188', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c159c5-9ce1-4e0a-b5a2-6567b1b371ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (37c159c5-9ce1-4e0a-b5a2-6567b1b371ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6f14fe-1f11-4ced-ae74-b986f100fc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Volume df159a4b-8916-4fd9-8fc9-db13df920188: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df159a4b-8916-4fd9-8fc9-db13df920188', 'volume_size': 1} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:23 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3" returned: 0 in 0.307s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.231s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-464443933',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df159a4b-8916-4fd9-8fc9-db13df920188,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db63a868af94407385877c4c24eac83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:23Z,use_quota=True,user_id='d44cf8d26c1e46d9864541ab347e4a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Creating volume df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:23 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020793be-551f-4c78-ac17-066bdabbef16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ff7ff46-a561-4775-82fc-db09078e35c3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 1073741824 Nov 05 11:13:23 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bb49fa-0213-4bab-aefe-f441005cade2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-0ff7ff46-a561-4775-82fc-db09078e35c3 (0ff7ff46-a561-4775-82fc-db09078e35c3): created successfully Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06bb49fa-0213-4bab-aefe-f441005cade2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (c0e8189c-49f9-4d4b-b4fb-eaecc566a84f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:23 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cab34e30-0575-421b-b8a6-2e65f759c576 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:23 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 1073741824" returned: 0 in 0.505s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:23 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:23 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:24 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.280s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be6f14fe-1f11-4ced-ae74-b986f100fc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df159a4b-8916-4fd9-8fc9-db13df920188', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2758545c-f09d-4dc8-8f64-0826c6c58c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Volume volume-df159a4b-8916-4fd9-8fc9-db13df920188 (df159a4b-8916-4fd9-8fc9-db13df920188): created successfully Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2758545c-f09d-4dc8-8f64-0826c6c58c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Flow 'volume_create_manager' (e2201f82-0bd3-462e-b679-22132cea0502) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ca4719bc-d0c2-49fc-b9bc-9b62bb8c50e8 tempest-VolumeDependencyTests-776316103 None] Created volume successfully. Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating offline snapshot 55b43823-7021-4c07-bd50-18ea525c637b of volume 0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[153d7fdf-b1f6-49c0-8acf-1565d3f6abc3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:24 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 Nov 05 11:13:24 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:25 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:25 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b 1G Nov 05 11:13:25 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:25 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b 1G" returned: 0 in 0.520s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff7ff46-a561-4775-82fc-db09078e35c3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:25 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff7ff46-a561-4775-82fc-db09078e35c3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b Nov 05 11:13:25 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:25 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ff7ff46-a561-4775-82fc-db09078e35c3 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b" returned: 0 in 0.344s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:25 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b is being set with open permissions: ugo+rw Nov 05 11:13:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:25 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b Nov 05 11:13:25 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:26 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b" returned: 0 in 0.302s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:26 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info Nov 05 11:13:26 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:26 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:26 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info is being set with open permissions: ugo+rw Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:26 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info Nov 05 11:13:26 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:26 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.info" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.298s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.535s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Creating offline snapshot da89d2ac-4b55-44be-b217-c80961c0d882 of volume df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:13:26 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ada96640-6eee-4a99-9445-3db5990791ce tempest-CreateVolumesFromSnapshotTest-1613014835 None] Create snapshot completed successfully Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[914a1ed4-aa4f-4813-bee9-7aee85ce17df]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:27 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:27 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:27 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.428s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:27 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 1G Nov 05 11:13:27 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Flow 'volume_create_manager' (66c4459b-0b00-4eaa-8839-4d9a40938c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6291cf-5f5b-4801-92c4-a6a059212e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e6291cf-5f5b-4801-92c4-a6a059212e85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ab45f9-0c78-420e-85c4-64cbe27e5ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbb463d22f54214a8b73042b1881a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:28Z,use_quota=True,user_id='3bcf3f51a67a41d9b0ecdd9fecb1c360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92469c5d-e6d5-4a06-af71-5aaed5803e4d),volume_type_id=92469c5d-e6d5-4a06-af71-5aaed5803e4d)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eadf00-28f4-4439-9c4f-408fe4fa100c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9eadf00-28f4-4439-9c4f-408fe4fa100c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b1efeb-73bb-4a75-90ef-5779dda64480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:13:27 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 1G" returned: 0 in 0.567s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df159a4b-8916-4fd9-8fc9-db13df920188 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:28 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df159a4b-8916-4fd9-8fc9-db13df920188 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:28 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:28 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-df159a4b-8916-4fd9-8fc9-db13df920188 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.415s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:28 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 is being set with open permissions: ugo+rw Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:28 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:28 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (4cdb28e6-6665-470e-82b5-9c615114e1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211bb135-c172-4a71-95f3-1b7384f85887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b1efeb-73bb-4a75-90ef-5779dda64480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a3ab45f9-0c78-420e-85c4-64cbe27e5ef3', 'volume_name': 'volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3', 'volume_size': 1, 'image_id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c25a0461a2d15bbcef98d789cf2d806d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dbb463d22f54214a8b73042b1881a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdfd90e2f7ec135395a60362992fa20e43dd5ce220fe9dd79bc47e8babd4cdb34187b11c59f3ee459a271f381a3cb9080bf36d0b977c7d21c315c859aa9acb3e', 'id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'created_at': datetime.datetime(2026, 11, 5, 10, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f6dd490-92df-4d3e-8667-8020707c6d07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a6a985-2dd4-4588-a0ae-bec71a71d21f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92a6a985-2dd4-4588-a0ae-bec71a71d21f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0776d0e-91fd-4819-8e33-9a7c81295fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3', 'volume_size': 1, 'image_id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c25a0461a2d15bbcef98d789cf2d806d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dbb463d22f54214a8b73042b1881a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdfd90e2f7ec135395a60362992fa20e43dd5ce220fe9dd79bc47e8babd4cdb34187b11c59f3ee459a271f381a3cb9080bf36d0b977c7d21c315c859aa9acb3e', 'id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'created_at': datetime.datetime(2026, 11, 5, 10, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f6dd490-92df-4d3e-8667-8020707c6d07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Trying to clone a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 from image 7f6dd490-92df-4d3e-8667-8020707c6d07 at location (None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (211bb135-c172-4a71-95f3-1b7384f85887) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804305837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7d8a2b-65d0-433d-95e9-01813a20852f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:28Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701dfab-564c-4c0a-90e6-73d637db6512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1701dfab-564c-4c0a-90e6-73d637db6512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a353c0-99c8-4d77-8d4c-cb9f1a7e623e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0a353c0-99c8-4d77-8d4c-cb9f1a7e623e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7d8a2b-65d0-433d-95e9-01813a20852f', 'volume_name': 'volume-ff7d8a2b-65d0-433d-95e9-01813a20852f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fcc60-74c1-4a9c-b56d-a37b349ee61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b7fcc60-74c1-4a9c-b56d-a37b349ee61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c8e22-0389-4a0c-8e5a-dcbabf79dd4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:28 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume ff7d8a2b-65d0-433d-95e9-01813a20852f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7d8a2b-65d0-433d-95e9-01813a20852f', 'volume_size': 1} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:28 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.390s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:13:28 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Image download 0.00 MB at 0.00 MB/s Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dae9b1d6-79ea-49b2-8f38-4a341e6620b1]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:28 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info Nov 05 11:13:28 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:29 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:29 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (d2f2c4df-0812-4a9a-84b0-bff611930f09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6ed89c-3b7e-49d4-a7a6-2b28d159e4cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b6ed89c-3b7e-49d4-a7a6-2b28d159e4cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261198249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fd1313-d3a3-4687-8dd4-93482972ef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:29Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e5c83-b50f-490f-8b9f-e1d7ce44e082) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (797e5c83-b50f-490f-8b9f-e1d7ce44e082) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c8d8e1-3750-480d-8751-8148211a83f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88c8d8e1-3750-480d-8751-8148211a83f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2fd1313-d3a3-4687-8dd4-93482972ef5a', 'volume_name': 'volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f71770c-e671-4dd4-86cf-697eebbe5da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f71770c-e671-4dd4-86cf-697eebbe5da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91fb37a-1939-4984-b4ed-dbd0bba72907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume e2fd1313-d3a3-4687-8dd4-93482972ef5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a', 'volume_size': 1} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:29 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info" returned: 0 in 0.468s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:29 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info is being set with open permissions: ugo+rw Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:29 devstack sudo[106227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info Nov 05 11:13:29 devstack sudo[106227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:29 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 0 in 0.618s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (62cded6c-b7c9-40c4-ae04-f5361b6942c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a44c2b-553b-4764-935a-d638c47c4d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a44c2b-553b-4764-935a-d638c47c4d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-297334851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a77508-817c-4c49-b84a-28dc4ffb5bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc96125-bfef-4fc9-8f5b-2a366affe5f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bc96125-bfef-4fc9-8f5b-2a366affe5f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack sudo[106231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:29 devstack sudo[106231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b761ff-8b77-4ea7-ada7-960e3b04fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0b761ff-8b77-4ea7-ada7-960e3b04fa07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54a77508-817c-4c49-b84a-28dc4ffb5bcf', 'volume_name': 'volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc153b1f-314d-4e28-b5af-b69472533b25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack sudo[106227]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc153b1f-314d-4e28-b5af-b69472533b25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a2f849-c865-4c26-b809-1a4475283bdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume 54a77508-817c-4c49-b84a-28dc4ffb5bcf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf', 'volume_size': 1} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.info" returned: 0 in 0.382s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.826s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-804305837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7d8a2b-65d0-433d-95e9-01813a20852f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:28Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume ff7d8a2b-65d0-433d-95e9-01813a20852f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:29 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:29 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f 1073741824 Nov 05 11:13:29 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-85df9568-1ad3-43d9-b90e-38ecd5c4c7dd tempest-VolumeDependencyTests-776316103 None] Create snapshot completed successfully Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (e16a55f4-ca9b-4223-bc8d-7e350f7d7bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c4def-b128-4168-b439-6c1f69ad724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:29 devstack sudo[106231]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 1 in 0.492s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:13:29 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Temporary image 7f6dd490-92df-4d3e-8667-8020707c6d07 is fetched for user 3bcf3f51a67a41d9b0ecdd9fecb1c360. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc1c4def-b128-4168-b439-6c1f69ad724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992534399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3278d2d9-0636-4609-8d24-38eb49836c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9cf9b4-4cac-463d-aaea-011d160aeedf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9cf9b4-4cac-463d-aaea-011d160aeedf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c8bb4e-3648-4177-8e2f-c6b30b103c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19c8bb4e-3648-4177-8e2f-c6b30b103c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3278d2d9-0636-4609-8d24-38eb49836c36', 'volume_name': 'volume-3278d2d9-0636-4609-8d24-38eb49836c36', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204ac929-d6f6-4788-80ef-54358e2c3900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (204ac929-d6f6-4788-80ef-54358e2c3900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694c36b8-f6f1-46f8-8968-7d746dcdb44d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Volume 3278d2d9-0636-4609-8d24-38eb49836c36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3278d2d9-0636-4609-8d24-38eb49836c36', 'volume_size': 1} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51ed85b-6ad9-47b0-8016-052868beebdc]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:30 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:30 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:30 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (e729a3e7-b40e-4364-8eac-21cc51bf2d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d17cb5a-9a4f-4f83-97e3-cf3377f6fd5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f 1073741824" returned: 0 in 0.655s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d17cb5a-9a4f-4f83-97e3-cf3377f6fd5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-231563573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5219fe1-d779-4f2e-bb17-b32d0de973bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54b10c-327e-4c47-b464-8b2d42fd89d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e54b10c-327e-4c47-b464-8b2d42fd89d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60f4070-ad9a-4e73-995e-456faa8fcb6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f60f4070-ad9a-4e73-995e-456faa8fcb6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5219fe1-d779-4f2e-bb17-b32d0de973bb', 'volume_name': 'volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28bea0-25f2-4941-93f8-14616fdcd89c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b28bea0-25f2-4941-93f8-14616fdcd89c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63047061-5a01-4cbd-8b5c-0f47f9395cce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume a5219fe1-d779-4f2e-bb17-b32d0de973bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb', 'volume_size': 1} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:30 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:30 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f Nov 05 11:13:30 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:30 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (2c338e24-5e98-44a6-8ad1-36d759e03053) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb8215-1468-428a-b3a2-0422b6e95910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52fb8215-1468-428a-b3a2-0422b6e95910) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465794365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a54645-ceb6-4c78-aa57-b4924cf3895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:31Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e588b63f-6f3c-4cd8-ae44-5e59824d9d56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e588b63f-6f3c-4cd8-ae44-5e59824d9d56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8aee1c3-a38f-4dd1-84d3-b4973168d4bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8aee1c3-a38f-4dd1-84d3-b4973168d4bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90a54645-ceb6-4c78-aa57-b4924cf3895f', 'volume_name': 'volume-90a54645-ceb6-4c78-aa57-b4924cf3895f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f412021d-4d58-411d-b01e-0af575387601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f412021d-4d58-411d-b01e-0af575387601) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98080bcf-8577-4e78-b85e-857aff45d9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume 90a54645-ceb6-4c78-aa57-b4924cf3895f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90a54645-ceb6-4c78-aa57-b4924cf3895f', 'volume_size': 1} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:30 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.556s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-261198249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2fd1313-d3a3-4687-8dd4-93482972ef5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:29Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume e2fd1313-d3a3-4687-8dd4-93482972ef5a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f08c8e22-0389-4a0c-8e5a-dcbabf79dd4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7d8a2b-65d0-433d-95e9-01813a20852f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb136dc4-5c7a-4c4a-9760-e129f470ab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:30 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a 1073741824 Nov 05 11:13:30 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-ff7d8a2b-65d0-433d-95e9-01813a20852f (ff7d8a2b-65d0-433d-95e9-01813a20852f): created successfully Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb136dc4-5c7a-4c4a-9760-e129f470ab19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:30 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (4cdb28e6-6665-470e-82b5-9c615114e1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:30 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-641c053a-8cf1-48fe-8138-63b5f95e8fc5 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:31 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 1 in 0.518s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:31 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a 1073741824" returned: 0 in 0.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:31 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a Nov 05 11:13:31 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Flow 'volume_create_manager' (33b5afad-52ac-47db-a00f-70ab8ba1ffaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc46db56-fc5d-45fd-aae9-f78ea291bddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc46db56-fc5d-45fd-aae9-f78ea291bddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1352382203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15282d35-1a95-4b74-999e-4a573cfdbb08,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='db63a868af94407385877c4c24eac83d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=da89d2ac-4b55-44be-b217-c80961c0d882,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:31Z,use_quota=True,user_id='d44cf8d26c1e46d9864541ab347e4a08',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc03216-80b6-4c99-b17d-0338decd6302) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccc03216-80b6-4c99-b17d-0338decd6302) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80644a92-d788-4961-b602-c064d0fb7614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80644a92-d788-4961-b602-c064d0fb7614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '15282d35-1a95-4b74-999e-4a573cfdbb08', 'volume_name': 'volume-15282d35-1a95-4b74-999e-4a573cfdbb08', 'volume_size': 1, 'snapshot_id': 'da89d2ac-4b55-44be-b217-c80961c0d882'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b1270f-0991-4023-ad65-805c877363d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b1270f-0991-4023-ad65-805c877363d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b83ed2-a086-4477-bbc8-12e172e4aac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Volume 15282d35-1a95-4b74-999e-4a573cfdbb08: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-15282d35-1a95-4b74-999e-4a573cfdbb08', 'volume_size': 1, 'snapshot_id': 'da89d2ac-4b55-44be-b217-c80961c0d882'} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:31 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a" returned: 0 in 0.261s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-297334851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54a77508-817c-4c49-b84a-28dc4ffb5bcf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume 54a77508-817c-4c49-b84a-28dc4ffb5bcf {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:31 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a91fb37a-1939-4984-b4ed-dbd0bba72907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf 1073741824 Nov 05 11:13:31 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54a8f93-b3a8-4b54-a94a-7bafb44499d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:31 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a (e2fd1313-d3a3-4687-8dd4-93482972ef5a): created successfully Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e54a8f93-b3a8-4b54-a94a-7bafb44499d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (d2f2c4df-0812-4a9a-84b0-bff611930f09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:31 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-695c3e52-c66a-4f0a-871c-01bcba28f6d1 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:32 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf 1073741824" returned: 0 in 0.447s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:32 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf Nov 05 11:13:32 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:32 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf" returned: 0 in 0.261s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.414s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1992534399',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3278d2d9-0636-4609-8d24-38eb49836c36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Creating volume 3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:32 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a2f849-c865-4c26-b809-1a4475283bdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:32 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 1073741824 Nov 05 11:13:32 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5180408-1061-4bd5-b980-e09a4b1e51f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:32 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf (54a77508-817c-4c49-b84a-28dc4ffb5bcf): created successfully Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5180408-1061-4bd5-b980-e09a4b1e51f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (62cded6c-b7c9-40c4-ae04-f5361b6942c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-503807e9-0eec-4bea-b207-1b7c7bebaa28 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:32 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 1073741824" returned: 0 in 0.433s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:32 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 Nov 05 11:13:32 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:33 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36" returned: 0 in 0.255s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.756s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-231563573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5219fe1-d779-4f2e-bb17-b32d0de973bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:30Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume a5219fe1-d779-4f2e-bb17-b32d0de973bb {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:33 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (694c36b8-f6f1-46f8-8968-7d746dcdb44d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3278d2d9-0636-4609-8d24-38eb49836c36', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:33 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb 1073741824 Nov 05 11:13:33 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58623eee-a965-4658-a6c2-7eb28c4fb390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:33 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Volume volume-3278d2d9-0636-4609-8d24-38eb49836c36 (3278d2d9-0636-4609-8d24-38eb49836c36): created successfully Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58623eee-a965-4658-a6c2-7eb28c4fb390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (e16a55f4-ca9b-4223-bc8d-7e350f7d7bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fee6c25f-2df3-4485-90d3-7e84d3f5839d tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:13:33 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb 1073741824" returned: 0 in 0.427s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:33 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb Nov 05 11:13:33 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:33 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb" returned: 0 in 0.249s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.162s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1465794365',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90a54645-ceb6-4c78-aa57-b4924cf3895f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86e6ae0bce5e435c82ea6fd5bece422f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:31Z,use_quota=True,user_id='69f0a3201014489cab1bb08a9408c226',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Creating volume 90a54645-ceb6-4c78-aa57-b4924cf3895f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:33 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63047061-5a01-4cbd-8b5c-0f47f9395cce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:33 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f 1073741824 Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9db2547-6d6c-4ce3-998f-d225e0bb6e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:33 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:33 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb (a5219fe1-d779-4f2e-bb17-b32d0de973bb): created successfully Nov 05 11:13:33 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9db2547-6d6c-4ce3-998f-d225e0bb6e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (e729a3e7-b40e-4364-8eac-21cc51bf2d6c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-da778296-13bd-43cd-b651-6d31d042cada tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:34 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f 1073741824" returned: 0 in 0.450s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:34 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f Nov 05 11:13:34 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:34 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f" returned: 0 in 0.276s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.816s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3ab45f9-0c78-420e-85c4-64cbe27e5ef3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0dbb463d22f54214a8b73042b1881a66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:28Z,use_quota=True,user_id='3bcf3f51a67a41d9b0ecdd9fecb1c360',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(92469c5d-e6d5-4a06-af71-5aaed5803e4d),volume_type_id=92469c5d-e6d5-4a06-af71-5aaed5803e4d)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Creating volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:34 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98080bcf-8577-4e78-b85e-857aff45d9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90a54645-ceb6-4c78-aa57-b4924cf3895f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:34 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1073741824 Nov 05 11:13:34 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3c2740-227c-460c-9079-ce60657de15d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:34 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Volume volume-90a54645-ceb6-4c78-aa57-b4924cf3895f (90a54645-ceb6-4c78-aa57-b4924cf3895f): created successfully Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b3c2740-227c-460c-9079-ce60657de15d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Flow 'volume_create_manager' (2c338e24-5e98-44a6-8ad1-36d759e03053) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cefa0ae1-5d26-495d-b622-27395a17672c tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created volume successfully. Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-90a54645-ceb6-4c78-aa57-b4924cf3895f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-90a54645-ceb6-4c78-aa57-b4924cf3895f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-90a54645-ceb6-4c78-aa57-b4924cf3895f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-90a54645-ceb6-4c78-aa57-b4924cf3895f" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fa1925-3862-49f4-ad63-e5cfff3f5eee]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:35 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1073741824" returned: 0 in 0.507s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:35 devstack sudo[106340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f Nov 05 11:13:35 devstack sudo[106340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:35 devstack sudo[106343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 Nov 05 11:13:35 devstack sudo[106343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:35 devstack sudo[106343]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" returned: 0 in 0.239s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] <== create_volume: return (785ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.995s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882-15282d35-1a95-4b74-999e-4a573cfdbb08" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:35 devstack sudo[106340]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f" returned: 0 in 0.369s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882-15282d35-1a95-4b74-999e-4a573cfdbb08" acquired by "_create_volume_from_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Creating volume 15282d35-1a95-4b74-999e-4a573cfdbb08 from snapshot da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:35 devstack sudo[106349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f Nov 05 11:13:35 devstack sudo[106349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Attempting download of 7f6dd490-92df-4d3e-8667-8020707c6d07 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}])) to volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] snapshot: da89d2ac-4b55-44be-b217-c80961c0d882, volume: 15282d35-1a95-4b74-999e-4a573cfdbb08, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a36e61ac-ff22-4d56-8c29-10bc541128bb]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d67d6bd-f074-4d0e-96a6-37993b073e88]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:35 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx Nov 05 11:13:35 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:35 devstack sudo[106353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:35 devstack sudo[106353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:35 devstack sudo[106349]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90a54645-ceb6-4c78-aa57-b4924cf3895f" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-90a54645-ceb6-4c78-aa57-b4924cf3895f" released by "delete_volume" :: held 0.688s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:35 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['4a431e70-cb8b-42ad-b4c5-817e7b7a899e', 'f96f3afc-73b3-460d-9d3d-5e1f79ca11cb', 'f15e9f5d-3863-4937-af8f-4425f7a752e9', 'c387548a-af29-4d96-acac-02ac814e6682'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:36 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106353]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df159a4b-8916-4fd9-8fc9-db13df920188(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9251eaf3-74c8-4282-b075-7f91656461ef]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx Nov 05 11:13:36 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:36 devstack sudo[106366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:36 devstack sudo[106366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-a5219fe1-d779-4f2e-bb17-b32d0de973bb-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-37cbe8a7-ed1d-4fff-b196-269717adb117 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-90a54645-ceb6-4c78-aa57-b4924cf3895f-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-a5219fe1-d779-4f2e-bb17-b32d0de973bb-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-a5219fe1-d779-4f2e-bb17-b32d0de973bb" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-a5219fe1-d779-4f2e-bb17-b32d0de973bb" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[23c62f37-160f-4217-8ab6-e19f461a9210]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx" returned: 1 in 0.428s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7f6dd490-92df-4d3e-8667-8020707c6d07_hqufiokx' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[51db4191-a612-48da-bd74-0678f94f2dfc]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb Nov 05 11:13:36 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack sudo[106366]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.452s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:36 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 Nov 05 11:13:36 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:36 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb" returned: 0 in 0.425s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:36 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb Nov 05 11:13:36 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:37 devstack sudo[106388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD Nov 05 11:13:37 devstack sudo[106388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:37 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a5219fe1-d779-4f2e-bb17-b32d0de973bb" returned: 0 in 0.283s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-a5219fe1-d779-4f2e-bb17-b32d0de973bb" released by "delete_volume" :: held 0.770s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['54c7ff90-fe1b-4ef8-a633-b3f2dd99e370', '133fe505-1bf8-4283-b95e-56a1d3309e1e', '050ff559-2300-40a9-bd3c-1cf8af5d9b6b', '1e0d29b8-42b4-4ac6-9cc2-f99b82681a8a'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:37 devstack sudo[106388]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD" returned: 1 in 0.553s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] 7f6dd490-92df-4d3e-8667-8020707c6d07 was raw, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:37 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 Nov 05 11:13:37 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:37 devstack sudo[106407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:37 devstack sudo[106407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-54a77508-817c-4c49-b84a-28dc4ffb5bcf-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-54a77508-817c-4c49-b84a-28dc4ffb5bcf-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-54a77508-817c-4c49-b84a-28dc4ffb5bcf" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-54a77508-817c-4c49-b84a-28dc4ffb5bcf" acquired by "delete_volume" :: waited 0.031s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b5cb12-6318-426e-8d4e-80433553f6da]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:38 devstack sudo[106407]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.540s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:38 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:38 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf Nov 05 11:13:38 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a83a20bf-f076-4fbd-816e-4111ef8f7253 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-a5219fe1-d779-4f2e-bb17-b32d0de973bb-delete_volume" released by "delete_volume" :: held 1.907s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:38 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" returned: 0 in 1.128s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7f6dd490-92df-4d3e-8667-8020707c6d07_ryregguidevstack@QuobyteHD, size 0.00 MB, duration 1.14 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:13:38 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:38 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1G Nov 05 11:13:38 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:38 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf" returned: 0 in 0.732s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:38 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf Nov 05 11:13:38 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:39 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-54a77508-817c-4c49-b84a-28dc4ffb5bcf" returned: 0 in 0.389s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-54a77508-817c-4c49-b84a-28dc4ffb5bcf" released by "delete_volume" :: held 1.236s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['d64c4f97-1974-4e91-859f-71d9118803d5', '900eef16-22cd-44ef-88c7-f2c5b3bea015', '854f5267-490c-4d0b-98bb-e3e6c1288798', 'ffd49b2e-251d-4d47-8017-8dc8a4e15659'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:39 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 1G" returned: 0 in 0.806s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Downloaded image 7f6dd490-92df-4d3e-8667-8020707c6d07 ((None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}])) to volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Temporary image 7f6dd490-92df-4d3e-8667-8020707c6d07 for user 3bcf3f51a67a41d9b0ecdd9fecb1c360 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Marking volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:13:39 devstack sudo[106427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:39 devstack sudo[106427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Copying metadata from image 7f6dd490-92df-4d3e-8667-8020707c6d07 to a3ab45f9-0c78-420e-85c4-64cbe27e5ef3. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Creating volume glance metadata for volume a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 backed by image 7f6dd490-92df-4d3e-8667-8020707c6d07 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'c25a0461a2d15bbcef98d789cf2d806d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0776d0e-91fd-4819-8e33-9a7c81295fbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3', 'volume_size': 1, 'image_id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7f6dd490-92df-4d3e-8667-8020707c6d07', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c25a0461a2d15bbcef98d789cf2d806d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '0dbb463d22f54214a8b73042b1881a66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'cdfd90e2f7ec135395a60362992fa20e43dd5ce220fe9dd79bc47e8babd4cdb34187b11c59f3ee459a271f381a3cb9080bf36d0b977c7d21c315c859aa9acb3e', 'id': '7f6dd490-92df-4d3e-8667-8020707c6d07', 'created_at': datetime.datetime(2026, 11, 5, 10, 13, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 13, 27, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7f6dd490-92df-4d3e-8667-8020707c6d07/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5834da3c-d84f-498b-88cb-864814664bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:39 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Volume volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 (a3ab45f9-0c78-420e-85c4-64cbe27e5ef3): created successfully Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5834da3c-d84f-498b-88cb-864814664bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Flow 'volume_create_manager' (66c4459b-0b00-4eaa-8839-4d9a40938c1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7cdcc375-1311-4c82-8685-3c384acaa137 tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Created volume successfully. Nov 05 11:13:39 devstack sudo[106427]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.474s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a4f3f500-087a-4293-b538-94850ce32f5e tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-54a77508-817c-4c49-b84a-28dc4ffb5bcf-delete_volume" released by "delete_volume" :: held 2.146s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-e2fd1313-d3a3-4687-8dd4-93482972ef5a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-e2fd1313-d3a3-4687-8dd4-93482972ef5a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-e2fd1313-d3a3-4687-8dd4-93482972ef5a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-e2fd1313-d3a3-4687-8dd4-93482972ef5a" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c9f3303-2c4a-42d5-bf83-4b9350735ff9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:40 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a Nov 05 11:13:40 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:40 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a" returned: 0 in 0.519s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Acquiring lock "cinder-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:40 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a Nov 05 11:13:40 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "cinder-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Acquiring lock "cinder-quobyte-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "cinder-quobyte-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[874607ce-9636-49d5-bd5b-95c9a0f8c7e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:41 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 Nov 05 11:13:41 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:41 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-e2fd1313-d3a3-4687-8dd4-93482972ef5a" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-e2fd1313-d3a3-4687-8dd4-93482972ef5a" released by "delete_volume" :: held 1.099s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['9d99f0a4-19c6-4f17-9351-5c2902bb2b84', 'c2287a7e-af1d-421a-85c6-0c6829344ae1', '7bbe7659-1fd1-4c5e-a6a2-b10d6ee91a40', '17d5f166-abb2-48a0-bebe-35a91628ff6f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:41 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:41 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:41 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" returned: 0 in 0.651s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:41 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3 Nov 05 11:13:41 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:42 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.533s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d497d04e-8748-4a76-83c2-25d8029a8d20 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-e2fd1313-d3a3-4687-8dd4-93482972ef5a-delete_volume" released by "delete_volume" :: held 2.114s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:42 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" returned: 0 in 0.672s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "cinder-quobyte-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3" released by "delete_volume" :: held 1.399s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Created reservations ['9f7b6a08-d2f3-454b-b7ee-c049caad2267', '11ac62a8-753d-4211-ae62-e8de22e8bb46', 'dcbd91cb-fe5b-4830-ba54-ca61cb9f284a', '41af9d82-8207-4ead-a8d0-48d38c69e2a2'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-ff7d8a2b-65d0-433d-95e9-01813a20852f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-ff7d8a2b-65d0-433d-95e9-01813a20852f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-ff7d8a2b-65d0-433d-95e9-01813a20852f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-ff7d8a2b-65d0-433d-95e9-01813a20852f" acquired by "delete_volume" :: waited 0.035s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5a952ae-58cf-4acc-825b-dad25f872dce]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:42 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:42 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:43 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f Nov 05 11:13:43 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:43 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.571s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:43 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:43 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Deleted volume successfully. Nov 05 11:13:43 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a09ddd5e-f66a-4e48-9c0f-8d6525e1a01e tempest-VolumeAndVolumeTypeFromImageTest-894388760 None] Lock "cinder-a3ab45f9-0c78-420e-85c4-64cbe27e5ef3-delete_volume" released by "delete_volume" :: held 2.512s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:43 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f" returned: 0 in 0.957s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:43 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f Nov 05 11:13:43 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:44 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ff7d8a2b-65d0-433d-95e9-01813a20852f" returned: 0 in 0.402s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-ff7d8a2b-65d0-433d-95e9-01813a20852f" released by "delete_volume" :: held 1.458s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['8e7376a8-6a96-40a3-9a8f-edb1ff951170', '5ca39066-7b4d-4ca8-bf4a-de096b4a0732', '5261b4bd-6933-4baa-8dab-89352203c625', '02308811-0574-4231-ae1a-ac26235c589c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:44 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:44 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:44 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08" returned: 0 in 7.975s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188, size 1024.00 MB, duration 7.98 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:13:44 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Converted 1024.00 MB image at 128.34 MB/s Nov 05 11:13:44 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 is being set with open permissions: ugo+rw Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:44 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 Nov 05 11:13:44 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:44 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4d5f7972-a120-4b37-9a3e-20db3faee445 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-ff7d8a2b-65d0-433d-95e9-01813a20852f-delete_volume" released by "delete_volume" :: held 2.160s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:44 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" released by "_copy_volume_from_snapshot" :: held 9.227s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882-15282d35-1a95-4b74-999e-4a573cfdbb08" released by "_create_volume_from_snapshot" :: held 9.298s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.331s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.234s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot 853ad5ab-958f-453f-b27b-60096cc70415 of volume 3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57b83ed2-a086-4477-bbc8-12e172e4aac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15282d35-1a95-4b74-999e-4a573cfdbb08', 'volume_size': 1, 'snapshot_id': 'da89d2ac-4b55-44be-b217-c80961c0d882'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f6bf22-d3ed-436a-9f33-c6ea996e33aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[68669e5c-e4dd-4ca4-aa5a-742c53817d57]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Volume volume-15282d35-1a95-4b74-999e-4a573cfdbb08 (15282d35-1a95-4b74-999e-4a573cfdbb08): created successfully Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5f6bf22-d3ed-436a-9f33-c6ea996e33aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Flow 'volume_create_manager' (33b5afad-52ac-47db-a00f-70ab8ba1ffaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4615fa4b-3322-4a88-94cb-cd52d749240e tempest-VolumeDependencyTests-776316103 None] Created volume successfully. Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-55b43823-7021-4c07-bd50-18ea525c637b-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-55b43823-7021-4c07-bd50-18ea525c637b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-55b43823-7021-4c07-bd50-18ea525c637b" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-55b43823-7021-4c07-bd50-18ea525c637b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleting offline snapshot 55b43823-7021-4c07-bd50-18ea525c637b of volume 0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:13:45 devstack sudo[106470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 Nov 05 11:13:45 devstack sudo[106470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] snapshot_file for this snap is: volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[64132a64-49c0-4e6b-baa6-f0dc71e00f3f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:45 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b Nov 05 11:13:45 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:45 devstack sudo[106470]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36" returned: 0 in 0.446s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:45 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 1G Nov 05 11:13:45 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:45 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ff7ff46-a561-4775-82fc-db09078e35c3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f676cc6-2d6a-468b-9b7d-6568961a9ab3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:45 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 Nov 05 11:13:45 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-da89d2ac-4b55-44be-b217-c80961c0d882-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-da89d2ac-4b55-44be-b217-c80961c0d882-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Deleting offline snapshot da89d2ac-4b55-44be-b217-c80961c0d882 of volume df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] snapshot_file for this snap is: volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc011de1-d2cb-4cba-87ab-7ca6e3fd4d21]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 1G" returned: 0 in 0.558s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3278d2d9-0636-4609-8d24-38eb49836c36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3278d2d9-0636-4609-8d24-38eb49836c36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 Nov 05 11:13:46 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:46 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3" returned: 0 in 0.464s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b Nov 05 11:13:46 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3278d2d9-0636-4609-8d24-38eb49836c36 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415" returned: 0 in 0.349s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 is being set with open permissions: ugo+rw Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 Nov 05 11:13:46 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.502s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-df159a4b-8916-4fd9-8fc9-db13df920188(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[15f99139-5e46-4c0b-b661-10efcf14ee9b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b" returned: 0 in 0.452s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b Nov 05 11:13:46 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:46 devstack sudo[106510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415" returned: 0 in 0.332s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:46 devstack sudo[106515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info Nov 05 11:13:46 devstack sudo[106515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:46 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3.55b43823-7021-4c07-bd50-18ea525c637b" returned: 0 in 0.359s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-55b43823-7021-4c07-bd50-18ea525c637b" released by "_delete_snapshot" :: held 1.850s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" released by "delete_snapshot" :: held 1.881s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:47 devstack sudo[106515]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info is being set with open permissions: ugo+rw Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:47 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info Nov 05 11:13:47 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['0fc0e422-0ab8-4602-a623-aa2b3ca4b586', 'cd89d3de-0600-4e23-bce1-b23cc1616bb5', '8983a0b5-a026-4710-a5f6-50340eb65991', 'c8069fc8-798b-42f3-9860-f58791af4262'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:47 devstack sudo[106510]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.686s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Delete snapshot completed successfully. Nov 05 11:13:47 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:47 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d5e4ac57-a26d-4121-8324-fd15e016a972 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-55b43823-7021-4c07-bd50-18ea525c637b-delete_snapshot" released by "delete_snapshot" :: held 2.125s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:47 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-0ff7ff46-a561-4775-82fc-db09078e35c3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.info" returned: 0 in 0.339s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-0ff7ff46-a561-4775-82fc-db09078e35c3-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-07cf25ab-92c9-4b4b-b6c9-a4ae07bfb463 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[350e2525-055d-48d8-b5e5-79a8e05ea7c0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:47 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.479s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:47 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 Nov 05 11:13:47 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:47 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882 Nov 05 11:13:47 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:47 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188.da89d2ac-4b55-44be-b217-c80961c0d882" returned: 0 in 0.262s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:47 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-da89d2ac-4b55-44be-b217-c80961c0d882" released by "_delete_snapshot" :: held 2.102s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" released by "delete_snapshot" :: held 2.131s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:48 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3 Nov 05 11:13:48 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Created reservations ['ab4be61a-6e1f-404b-919d-290365a4df64', '9004aba0-e184-4945-8f23-2398d826c273', '9799598d-9576-411f-a503-06235b4759ba', '8a821eee-f4c0-4ba7-905f-2886cf9d1fd2'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Delete snapshot completed successfully. Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-04b2138c-8ff3-4415-9689-526e4e7b5f05 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-da89d2ac-4b55-44be-b217-c80961c0d882-delete_snapshot" released by "delete_snapshot" :: held 2.296s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:48 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0ff7ff46-a561-4775-82fc-db09078e35c3" returned: 0 in 0.257s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-quobyte-0ff7ff46-a561-4775-82fc-db09078e35c3" released by "delete_volume" :: held 0.756s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Created reservations ['1202cfae-602c-4b25-8d30-e567e2e547cd', '310c4dfb-475a-405d-88d3-d10a1bcec379', '1227879b-1909-4aa6-ba5f-5211bead7261', '638646f6-7278-4dcc-9482-39daddbb3900'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:48 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:48 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-853ad5ab-958f-453f-b27b-60096cc70415-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-853ad5ab-958f-453f-b27b-60096cc70415-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-853ad5ab-958f-453f-b27b-60096cc70415" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-853ad5ab-958f-453f-b27b-60096cc70415" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot 853ad5ab-958f-453f-b27b-60096cc70415 of volume 3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad01cc70-8d8b-491d-9c1a-f0dbaf0cd248]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:48 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:48 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Deleted volume successfully. Nov 05 11:13:48 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-496852d3-9981-4823-ab1b-83aba41703e4 tempest-CreateVolumesFromSnapshotTest-1613014835 None] Lock "cinder-0ff7ff46-a561-4775-82fc-db09078e35c3-delete_volume" released by "delete_volume" :: held 1.321s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:48 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 Nov 05 11:13:48 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-df159a4b-8916-4fd9-8fc9-db13df920188-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-df159a4b-8916-4fd9-8fc9-db13df920188-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:49 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3278d2d9-0636-4609-8d24-38eb49836c36(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" acquired by "delete_volume" :: waited 0.048s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f68d3207-6136-48b5-a5f0-a0738f57890a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[da69d076-b217-48eb-8a97-15f7f8d1162e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:49 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:49 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:49 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 Nov 05 11:13:49 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:49 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.533s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:49 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188 Nov 05 11:13:49 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (e74ea070-64be-4bab-84ff-b26c6b4aa0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73cc5ca-8fa5-4130-b8c3-a53a2c94e68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:49 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36" returned: 0 in 0.627s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a73cc5ca-8fa5-4130-b8c3-a53a2c94e68f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1563228908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace2417b-5dcb-4ae6-9e95-0879faaf421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:50Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:49 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 Nov 05 11:13:49 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a2bed-c2bf-41e9-a9b9-ace52137cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (150a2bed-c2bf-41e9-a9b9-ace52137cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6e5933-2309-4bad-9c01-8fe6d512b4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e6e5933-2309-4bad-9c01-8fe6d512b4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace2417b-5dcb-4ae6-9e95-0879faaf421c', 'volume_name': 'volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be8c8da-f418-4918-b653-004ce0be5b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0be8c8da-f418-4918-b653-004ce0be5b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584da7e8-c279-491f-99ec-fd973c57993e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Volume ace2417b-5dcb-4ae6-9e95-0879faaf421c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c', 'volume_size': 1} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1563228908',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace2417b-5dcb-4ae6-9e95-0879faaf421c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:50Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Creating volume ace2417b-5dcb-4ae6-9e95-0879faaf421c {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:50 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:50 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c 1073741824 Nov 05 11:13:50 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:50 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:50 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:50 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-df159a4b-8916-4fd9-8fc9-db13df920188" returned: 0 in 0.493s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-df159a4b-8916-4fd9-8fc9-db13df920188" released by "delete_volume" :: held 1.136s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Created reservations ['053002a5-c3cb-42f4-8413-150deb12420a', '08ae493d-43cd-4105-b444-911f00fb97e3', '130b616c-31d9-4489-908c-a3f9f577ddb4', '0c2bb446-2758-49ef-86d9-1220fa2b7a50'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:50 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415" returned: 0 in 0.717s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:50 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415 Nov 05 11:13:50 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (0e082b56-1c7d-4e51-85e0-ae8240f2a97f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0898b7-c577-4575-9bb0-e21338cfb69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:50 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c 1073741824" returned: 0 in 0.697s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.471s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0898b7-c577-4575-9bb0-e21338cfb69c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-661725792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc338bf2-1c1b-462d-a8ee-81695a568303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:51Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e037366-4176-4be5-a8b7-29fd366d2f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e037366-4176-4be5-a8b7-29fd366d2f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc2312c-c3a1-48aa-9e65-17d553469c4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afc2312c-c3a1-48aa-9e65-17d553469c4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc338bf2-1c1b-462d-a8ee-81695a568303', 'volume_name': 'volume-cc338bf2-1c1b-462d-a8ee-81695a568303', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a41bd6b-7661-4141-835c-3eecc04e6504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a41bd6b-7661-4141-835c-3eecc04e6504) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0136c17-6c2e-46ba-be69-39471136fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Volume cc338bf2-1c1b-462d-a8ee-81695a568303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc338bf2-1c1b-462d-a8ee-81695a568303', 'volume_size': 1} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:50 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:50 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:50 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c Nov 05 11:13:50 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:51 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36.853ad5ab-958f-453f-b27b-60096cc70415" returned: 0 in 0.393s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-853ad5ab-958f-453f-b27b-60096cc70415" released by "_delete_snapshot" :: held 2.496s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" released by "delete_snapshot" :: held 2.528s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Created reservations ['5d3e6553-d6cb-462f-b9eb-4e2310698232', 'cf8e1433-27ba-4a03-a6d3-3fa46c33365c', '0a874207-6bd6-47f9-98bb-406be6627b4b', '7885fd6a-6318-49f0-9c50-8ec4a0a49eef'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:51 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.463s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Deleted volume successfully. Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3056e14a-7237-475e-8624-9b780a669a83 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-df159a4b-8916-4fd9-8fc9-db13df920188-delete_volume" released by "delete_volume" :: held 2.202s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:51 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c" returned: 0 in 0.500s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] <== create_volume: return (1363ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.366s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6ed98a57-3813-4b8c-91be-3576d16e3d50 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-853ad5ab-958f-453f-b27b-60096cc70415-delete_snapshot" released by "delete_snapshot" :: held 2.814s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-661725792',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc338bf2-1c1b-462d-a8ee-81695a568303,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:51Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Creating volume cc338bf2-1c1b-462d-a8ee-81695a568303 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:51 devstack sudo[106590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 1073741824 Nov 05 11:13:51 devstack sudo[106590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (584da7e8-c279-491f-99ec-fd973c57993e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cdc7ac-a397-4ec9-b961-e5307b03f260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-15282d35-1a95-4b74-999e-4a573cfdbb08-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Volume volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c (ace2417b-5dcb-4ae6-9e95-0879faaf421c): created successfully Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34cdc7ac-a397-4ec9-b961-e5307b03f260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (e74ea070-64be-4bab-84ff-b26c6b4aa0e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (404cf313-c279-412a-84a7-57dd60fa1043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1fecbc-90d2-4cef-9500-18c258b915c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-064b08aa-b20e-4676-a322-c964ed5cd5da tempest-CreateVolumesFromImageTest-170045745 None] Created volume successfully. Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-15282d35-1a95-4b74-999e-4a573cfdbb08-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b1fecbc-90d2-4cef-9500-18c258b915c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268977923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c22bd5-d87e-43a9-87a3-e9dfe0f9626f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:51Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a170205a-0a19-4d49-838a-dc49a453748f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a170205a-0a19-4d49-838a-dc49a453748f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c1413-b857-4f83-98c1-e0c7b0a96e4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956c1413-b857-4f83-98c1-e0c7b0a96e4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90c22bd5-d87e-43a9-87a3-e9dfe0f9626f', 'volume_name': 'volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f31f58-217c-4dee-9993-c01210a53824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f31f58-217c-4dee-9993-c01210a53824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e50bf-465d-40f5-a480-feb5f930d27d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:51 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Volume 90c22bd5-d87e-43a9-87a3-e9dfe0f9626f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f', 'volume_size': 1} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5697035-14a8-49a8-8e0b-aeeabde88739]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-3278d2d9-0636-4609-8d24-38eb49836c36-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-3278d2d9-0636-4609-8d24-38eb49836c36-delete_volume" acquired by "delete_volume" :: waited 0.069s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:52 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 Nov 05 11:13:52 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:52 devstack sudo[106590]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (ae7ac4c4-5ffa-4647-a961-990e9decb255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5898a444-d624-4460-aced-aa0eef291dd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" acquired by "delete_volume" :: waited 0.074s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 1073741824" returned: 0 in 0.764s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5898a444-d624-4460-aced-aa0eef291dd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929211981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cd3b30-42f7-415b-8df8-657faa59a676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:52Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add266ba-4b24-4da1-bcd2-65a99c423d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (add266ba-4b24-4da1-bcd2-65a99c423d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66072ce-835d-48e7-95f3-9a74742c7892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e66072ce-835d-48e7-95f3-9a74742c7892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84cd3b30-42f7-415b-8df8-657faa59a676', 'volume_name': 'volume-84cd3b30-42f7-415b-8df8-657faa59a676', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb4c639-59a5-4e83-b9ad-47936a74629d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcb4c639-59a5-4e83-b9ad-47936a74629d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ed818b-dd6a-477c-b3c4-8b65d01afbf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Volume 84cd3b30-42f7-415b-8df8-657faa59a676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84cd3b30-42f7-415b-8df8-657faa59a676', 'volume_size': 1} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2a4130-7f26-4105-86aa-5c2327e8aee4]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:52 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 Nov 05 11:13:52 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 Nov 05 11:13:52 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08" returned: 0 in 0.616s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:52 devstack sudo[106606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08 Nov 05 11:13:52 devstack sudo[106606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (48f10d14-b701-4108-b706-e333de832bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e880a9a-2f1c-43f5-a0ed-8215aaeb20da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8e880a9a-2f1c-43f5-a0ed-8215aaeb20da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546465167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64c8222-792d-482e-87bd-d92fb29e9716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:53Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5337cea7-ceca-4f6e-bde6-d040488a76d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5337cea7-ceca-4f6e-bde6-d040488a76d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dbc7a0-f408-4811-8e0b-8e01140f193f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2dbc7a0-f408-4811-8e0b-8e01140f193f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64c8222-792d-482e-87bd-d92fb29e9716', 'volume_name': 'volume-a64c8222-792d-482e-87bd-d92fb29e9716', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73727aec-ef0d-4940-ad2d-093d505610b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73727aec-ef0d-4940-ad2d-093d505610b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aecdd05-4f54-4112-bd7c-434a138f0dd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Volume a64c8222-792d-482e-87bd-d92fb29e9716: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64c8222-792d-482e-87bd-d92fb29e9716', 'volume_size': 1} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303" returned: 0 in 0.496s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] <== create_volume: return (1422ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.081s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1268977923',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90c22bd5-d87e-43a9-87a3-e9dfe0f9626f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:51Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:52 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Creating volume 90c22bd5-d87e-43a9-87a3-e9dfe0f9626f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:52 devstack sudo[106606]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-15282d35-1a95-4b74-999e-4a573cfdbb08" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36" returned: 0 in 0.602s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:52 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f 1073741824 Nov 05 11:13:52 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0136c17-6c2e-46ba-be69-39471136fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc338bf2-1c1b-462d-a8ee-81695a568303', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9011e322-e5a7-4a5c-b576-bd1ec59eb578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:52 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36 Nov 05 11:13:52 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-quobyte-15282d35-1a95-4b74-999e-4a573cfdbb08" released by "delete_volume" :: held 1.110s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Volume volume-cc338bf2-1c1b-462d-a8ee-81695a568303 (cc338bf2-1c1b-462d-a8ee-81695a568303): created successfully Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9011e322-e5a7-4a5c-b576-bd1ec59eb578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (0e082b56-1c7d-4e51-85e0-ae8240f2a97f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bb2a58cc-6767-4def-a8cd-07fb06b9901e tempest-CreateVolumesFromImageTest-170045745 None] Created volume successfully. Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Created reservations ['e94dd719-bfde-4c93-9758-02185ec83792', '986406d7-527f-432c-823a-250dff59a198', '638626a0-c1cb-4290-901b-87c27912473d', '1e7f7439-b8cd-4f95-b655-a487c0bbb8f8'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:53 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3278d2d9-0636-4609-8d24-38eb49836c36" returned: 0 in 0.426s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:53 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:53 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-3278d2d9-0636-4609-8d24-38eb49836c36" released by "delete_volume" :: held 1.192s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Created reservations ['461ad1c6-07bd-4bcf-9304-729a430561fd', '0e3f93a8-7fbc-4ff1-b004-aa99c256e1a2', 'a06b5e9b-6877-464e-939e-061ed54f01b6', '0e9e39ad-3af9-43d7-bf0d-0dc164951191'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:53 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:53 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:53 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:53 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (efe0d006-b7b8-4c27-aff6-58ad241ac3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbee16e6-a869-4c8a-9d17-e0edef9c28df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.326s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f 1073741824" returned: 0 in 0.744s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Deleted volume successfully. Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbee16e6-a869-4c8a-9d17-e0edef9c28df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164661945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0af992a-f8b2-4255-9caf-a471fe3c07f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:53Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9366e4-b1fa-4654-8ec7-1e57965fefaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cf9366e4-b1fa-4654-8ec7-1e57965fefaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eb068a-166f-4d87-be29-c054124454cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54eb068a-166f-4d87-be29-c054124454cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0af992a-f8b2-4255-9caf-a471fe3c07f6', 'volume_name': 'volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675d93a3-1004-47bf-b6c8-56081d8fda5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (675d93a3-1004-47bf-b6c8-56081d8fda5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9bf1e-0747-45ee-ad93-217b7630efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume b0af992a-f8b2-4255-9caf-a471fe3c07f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6', 'volume_size': 1} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-23aa0172-6001-4cdc-951c-e8ba01532e21 tempest-VolumeDependencyTests-776316103 None] Lock "cinder-15282d35-1a95-4b74-999e-4a573cfdbb08-delete_volume" released by "delete_volume" :: held 2.012s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:53 devstack sudo[106628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f Nov 05 11:13:53 devstack sudo[106628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:53 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.282s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7f20ab7-5dd9-4a8f-afb5-ba20009dc2d8 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-3278d2d9-0636-4609-8d24-38eb49836c36-delete_volume" released by "delete_volume" :: held 1.826s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:53 devstack sudo[106628]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" returned: 0 in 0.277s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] <== create_volume: return (1138ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.724s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1929211981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84cd3b30-42f7-415b-8df8-657faa59a676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:52Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Creating volume 84cd3b30-42f7-415b-8df8-657faa59a676 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a1e50bf-465d-40f5-a480-feb5f930d27d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 1073741824 Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb929005-67c3-4fe2-8bcf-14e8a13c8699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Volume volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f (90c22bd5-d87e-43a9-87a3-e9dfe0f9626f): created successfully Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb929005-67c3-4fe2-8bcf-14e8a13c8699) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (404cf313-c279-412a-84a7-57dd60fa1043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-54a9c9db-f902-453b-89fb-c2d9272501f1 tempest-CreateVolumesFromImageTest-170045745 None] Created volume successfully. Nov 05 11:13:54 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 1073741824" returned: 0 in 0.546s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:54 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 Nov 05 11:13:54 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (8c4d2f13-9dbb-47a1-b915-869c0683562b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c6ebb0-a1bb-44e8-89c6-4d263ecb6f34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03c6ebb0-a1bb-44e8-89c6-4d263ecb6f34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380956502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fe5b26-6334-4bc1-9417-02734d5a071b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:55Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717546f1-7fbd-4680-befa-a90bd07a6921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717546f1-7fbd-4680-befa-a90bd07a6921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de678869-fec5-482d-aa8a-9195c757781b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de678869-fec5-482d-aa8a-9195c757781b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '93fe5b26-6334-4bc1-9417-02734d5a071b', 'volume_name': 'volume-93fe5b26-6334-4bc1-9417-02734d5a071b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc76038-55f3-429e-ac9b-0350de0e7557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cfc76038-55f3-429e-ac9b-0350de0e7557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace3a00b-c62b-4de8-ad19-346e8ca5cb53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Volume 93fe5b26-6334-4bc1-9417-02734d5a071b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-93fe5b26-6334-4bc1-9417-02734d5a071b', 'volume_size': 1} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.910s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.062s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-546465167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64c8222-792d-482e-87bd-d92fb29e9716,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='70cf6313c7eb4a218d131411eef14bbb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:53Z,use_quota=True,user_id='0c553ac3d44d49eab7da371d02905e5d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Creating volume a64c8222-792d-482e-87bd-d92fb29e9716 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0ed818b-dd6a-477c-b3c4-8b65d01afbf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84cd3b30-42f7-415b-8df8-657faa59a676', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 1073741824 Nov 05 11:13:54 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f62d5-3ce3-42db-9623-d7f64f403422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Volume volume-84cd3b30-42f7-415b-8df8-657faa59a676 (84cd3b30-42f7-415b-8df8-657faa59a676): created successfully Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db5f62d5-3ce3-42db-9623-d7f64f403422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (ae7ac4c4-5ffa-4647-a961-990e9decb255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-26c34a49-8554-4092-95c6-fad315d8bbcb tempest-CreateVolumesFromImageTest-170045745 None] Created volume successfully. Nov 05 11:13:55 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 1073741824" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:55 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 Nov 05 11:13:55 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:55 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716" returned: 0 in 0.257s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-164661945',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0af992a-f8b2-4255-9caf-a471fe3c07f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:53Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume b0af992a-f8b2-4255-9caf-a471fe3c07f6 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:55 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aecdd05-4f54-4112-bd7c-434a138f0dd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64c8222-792d-482e-87bd-d92fb29e9716', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ade0aa-8fa6-41d4-b40a-851afc0dee6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:55 devstack sudo[106649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 1073741824 Nov 05 11:13:55 devstack sudo[106649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:55 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Volume volume-a64c8222-792d-482e-87bd-d92fb29e9716 (a64c8222-792d-482e-87bd-d92fb29e9716): created successfully Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12ade0aa-8fa6-41d4-b40a-851afc0dee6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Flow 'volume_create_manager' (48f10d14-b701-4108-b706-e333de832bea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:55 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a09cede5-03ac-4c6d-8da7-bb55238e42ee tempest-CreateVolumesFromImageTest-170045745 None] Created volume successfully. Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-a64c8222-792d-482e-87bd-d92fb29e9716-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-a64c8222-792d-482e-87bd-d92fb29e9716-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-quobyte-a64c8222-792d-482e-87bd-d92fb29e9716" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-a64c8222-792d-482e-87bd-d92fb29e9716" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:56 devstack sudo[106649]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 1073741824" returned: 0 in 0.585s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a0c6e9c-67a1-4aa1-8262-c168bb6aed72]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:56 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 Nov 05 11:13:56 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:56 devstack sudo[106655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 Nov 05 11:13:56 devstack sudo[106655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:56 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.722s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1380956502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=93fe5b26-6334-4bc1-9417-02734d5a071b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:55Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Creating volume 93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:56 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:56 devstack sudo[106662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b 1073741824 Nov 05 11:13:56 devstack sudo[106662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bf9bf1e-0747-45ee-ad93-217b7630efcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f87944c-ece8-42ab-8b23-c907291f36a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:56 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 (b0af992a-f8b2-4255-9caf-a471fe3c07f6): created successfully Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f87944c-ece8-42ab-8b23-c907291f36a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:56 devstack sudo[106655]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (efe0d006-b7b8-4c27-aff6-58ad241ac3a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-923abb57-3dcb-4e9d-a701-f2659211e8d5 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:13:56 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716 Nov 05 11:13:56 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:57 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a64c8222-792d-482e-87bd-d92fb29e9716" returned: 0 in 0.338s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-a64c8222-792d-482e-87bd-d92fb29e9716" released by "delete_volume" :: held 0.823s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Flow 'volume_create_manager' (098297c4-8419-4f4b-a6f1-2345b772d6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50361288-95c7-43e0-a03c-e04b4d7c0861) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50361288-95c7-43e0-a03c-e04b4d7c0861) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1792a7ae2164e10a6d1f904ed9b61a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:57Z,use_quota=True,user_id='853389e4ddf24b52a95bcf1e4155bb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack sudo[106662]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd97aef9-eb60-420f-a5df-493a7c806465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd97aef9-eb60-420f-a5df-493a7c806465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71171d3f-67c9-4e0b-8969-683916120a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71171d3f-67c9-4e0b-8969-683916120a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3', 'volume_name': 'volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f409a322-5048-4634-a86d-4cfd56d66492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f409a322-5048-4634-a86d-4cfd56d66492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de4d03c-a599-4fa4-8fe9-7c006932ed46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Volume c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3', 'volume_size': 1} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b 1073741824" returned: 0 in 0.591s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Created reservations ['bdf7ea4a-cc26-4baf-b9df-f89ed9f0d3f8', '01bd8e0a-4206-40b9-92c8-3a8fcc17a38f', '1026baab-140a-4a47-8389-9191948125bf', 'bd9a4275-3414-40d5-a896-704bdb518489'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:57 devstack sudo[106672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b Nov 05 11:13:57 devstack sudo[106672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:57 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:57 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:57 devstack sudo[106672]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b" returned: 0 in 0.259s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (909ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.320s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:57Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1792a7ae2164e10a6d1f904ed9b61a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:57Z,use_quota=True,user_id='853389e4ddf24b52a95bcf1e4155bb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Creating volume c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:13:57 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-84cd3b30-42f7-415b-8df8-657faa59a676-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:57 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 1073741824 Nov 05 11:13:57 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ace3a00b-c62b-4de8-ad19-346e8ca5cb53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-93fe5b26-6334-4bc1-9417-02734d5a071b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8150681-4acb-45eb-b1dc-871e8d437bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.289s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-84cd3b30-42f7-415b-8df8-657faa59a676-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Deleted volume successfully. Nov 05 11:13:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Volume volume-93fe5b26-6334-4bc1-9417-02734d5a071b (93fe5b26-6334-4bc1-9417-02734d5a071b): created successfully Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e8150681-4acb-45eb-b1dc-871e8d437bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (8c4d2f13-9dbb-47a1-b915-869c0683562b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-934736c0-5c74-458b-b573-958c88da6ece tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-fbb13e35-14ff-4cb2-9c0b-24cfb869f918 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-a64c8222-792d-482e-87bd-d92fb29e9716-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-quobyte-84cd3b30-42f7-415b-8df8-657faa59a676" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-84cd3b30-42f7-415b-8df8-657faa59a676" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a32fee-9bd6-49f9-b74c-10e45dcc1405]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:57 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 Nov 05 11:13:57 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:58 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 1073741824" returned: 0 in 0.683s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:58 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 Nov 05 11:13:58 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:58 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676" returned: 0 in 0.621s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:58 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676 Nov 05 11:13:58 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:58 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" returned: 0 in 0.312s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot 1083451a-7d29-4efc-9550-489628768df2 of volume 93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2de4d03c-a599-4fa4-8fe9-7c006932ed46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393f58d-50d6-4b12-a3c7-e5bd1aa8a5a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (182abfdd-1028-44b2-b410-52453e4e10e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6635759-4fa6-4d2d-aa89-46c471c5e275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9800e8e2-7555-42e8-a1e1-5a15078d3a05]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Volume volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 (c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3): created successfully Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3393f58d-50d6-4b12-a3c7-e5bd1aa8a5a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Flow 'volume_create_manager' (098297c4-8419-4f4b-a6f1-2345b772d6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86e8781d-d7dc-4a3e-afe6-7e0364eb48c1 tempest-CinderUnicodeTest-37177935 None] Created volume successfully. Nov 05 11:13:58 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6635759-4fa6-4d2d-aa89-46c471c5e275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-181350892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b0991-cf0b-4020-8921-bebb7299019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e10a1b2-c8c6-471d-bd38-aa7e94ef882c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e10a1b2-c8c6-471d-bd38-aa7e94ef882c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4e5c9-a669-4b96-ad42-3a6fa5f03622) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01b4e5c9-a669-4b96-ad42-3a6fa5f03622) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '912b0991-cf0b-4020-8921-bebb7299019c', 'volume_name': 'volume-912b0991-cf0b-4020-8921-bebb7299019c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2deb763-4391-4706-93f3-c080cba1755a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2deb763-4391-4706-93f3-c080cba1755a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b12159-d720-4f71-87ad-d82965462436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume 912b0991-cf0b-4020-8921-bebb7299019c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-912b0991-cf0b-4020-8921-bebb7299019c', 'volume_size': 1} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-84cd3b30-42f7-415b-8df8-657faa59a676" returned: 0 in 0.466s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:58 devstack sudo[106698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b Nov 05 11:13:58 devstack sudo[106698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-84cd3b30-42f7-415b-8df8-657faa59a676" released by "delete_volume" :: held 1.164s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (2903a514-d903-449a-83ef-618a0ab3da74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4206a768-59ee-4ccf-b0dd-40e06acd4748) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4206a768-59ee-4ccf-b0dd-40e06acd4748) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740349049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9788712-db3f-4a7b-99a0-e00c4f3d049f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8236d414-d175-466a-b1cc-635405b1f7f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8236d414-d175-466a-b1cc-635405b1f7f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8b5e32-2010-400a-94f6-2b7225b272ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f8b5e32-2010-400a-94f6-2b7225b272ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9788712-db3f-4a7b-99a0-e00c4f3d049f', 'volume_name': 'volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f659dba6-4bc4-4af0-b6af-c921907a7cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f659dba6-4bc4-4af0-b6af-c921907a7cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9488d4c-6848-4b76-b6ef-419ae0dc8862) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume a9788712-db3f-4a7b-99a0-e00c4f3d049f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f', 'volume_size': 1} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Created reservations ['2178437f-b396-4468-a5d6-b41bf2d2ea4d', 'bdfeabbd-f170-4a1e-9794-4553ffcce9b9', '4182d165-53c8-4620-a4d1-cf3c0d12586e', '9e6b0e39-07cf-456b-b391-e695150c9bf6'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:59 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:13:59 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:59 devstack sudo[106698]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b" returned: 0 in 0.511s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:59 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 1G Nov 05 11:13:59 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (7cc559b6-7a01-4316-aa5c-8b03336b00ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195555a8-befc-4e09-bd72-a686cbd6ce8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (195555a8-befc-4e09-bd72-a686cbd6ce8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988923293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb27b68-1c72-4158-970e-d2a5d7a07993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931be0e4-913f-42d0-839a-dc4ef0454a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (931be0e4-913f-42d0-839a-dc4ef0454a12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37da952-1c8a-4d6a-83c0-d1f4d65206ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f37da952-1c8a-4d6a-83c0-d1f4d65206ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5eb27b68-1c72-4158-970e-d2a5d7a07993', 'volume_name': 'volume-5eb27b68-1c72-4158-970e-d2a5d7a07993', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8e068e-6e19-4348-b109-8fbe403852d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f8e068e-6e19-4348-b109-8fbe403852d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc314d2-0d57-43d3-9279-dea05b8bd10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:13:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume 5eb27b68-1c72-4158-970e-d2a5d7a07993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5eb27b68-1c72-4158-970e-d2a5d7a07993', 'volume_size': 1} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.456s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:13:59 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Deleted volume successfully. Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-77e5b32f-7f31-4fdd-b6fa-71f13d8bcb90 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-84cd3b30-42f7-415b-8df8-657faa59a676-delete_volume" released by "delete_volume" :: held 2.030s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:13:59 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 1G" returned: 0 in 0.578s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:13:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe5b26-6334-4bc1-9417-02734d5a071b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:13:59 devstack sudo[106712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe5b26-6334-4bc1-9417-02734d5a071b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 Nov 05 11:13:59 devstack sudo[106712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (4f565fe6-c8b1-4714-87bb-eb0ccdd51863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9060d68-ebcf-4964-ab13-85f6e94f3e38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9060d68-ebcf-4964-ab13-85f6e94f3e38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771284286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11245068-5769-4d93-bb47-224e3feee7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:00Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c551ff-44c6-4f15-a079-85dba07931e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (47c551ff-44c6-4f15-a079-85dba07931e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3fd672-2034-4a3b-9491-3d32d9a055dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3fd672-2034-4a3b-9491-3d32d9a055dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11245068-5769-4d93-bb47-224e3feee7f1', 'volume_name': 'volume-11245068-5769-4d93-bb47-224e3feee7f1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a52f45-78ac-4811-8029-b1c09aa27503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8a52f45-78ac-4811-8029-b1c09aa27503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf18e30-b897-4854-b118-625f7701795c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume 11245068-5769-4d93-bb47-224e3feee7f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11245068-5769-4d93-bb47-224e3feee7f1', 'volume_size': 1} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-quobyte-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:00 devstack sudo[106712]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-93fe5b26-6334-4bc1-9417-02734d5a071b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:00 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 is being set with open permissions: ugo+rw Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" acquired by "delete_volume" :: waited 0.043s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:00 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 Nov 05 11:14:00 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe82ecf4-9096-48bc-943b-adde6ba7e2ea]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Flow 'volume_create_manager' (070045a6-0fd3-4af0-a540-494083865437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af19443-652a-402d-8f5b-ae82f440b040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9af19443-652a-402d-8f5b-ae82f440b040) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-688163958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d422f8-131d-4d48-930c-54ce35cf4bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1792a7ae2164e10a6d1f904ed9b61a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:00Z,use_quota=True,user_id='853389e4ddf24b52a95bcf1e4155bb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13acf1c-dea4-4ba1-b5cb-7442ae746ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b13acf1c-dea4-4ba1-b5cb-7442ae746ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e9d78-337b-4251-9633-5ca78ec237d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (870e9d78-337b-4251-9633-5ca78ec237d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7d422f8-131d-4d48-930c-54ce35cf4bb9', 'volume_name': 'volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f Nov 05 11:14:00 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955f9d46-2574-4c91-8054-a2b9c3e75c6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (955f9d46-2574-4c91-8054-a2b9c3e75c6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefa0c74-1dbb-4797-ab3e-2ea487458550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Volume d7d422f8-131d-4d48-930c-54ce35cf4bb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9', 'volume_size': 1} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (16ae88bc-2382-4b91-9831-7eaca343b4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945201d1-13ee-4270-8156-e6c466175655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (945201d1-13ee-4270-8156-e6c466175655) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686595790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c964b76-790b-40f9-accf-7f963dd928ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:01Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81550c8-cc49-4036-a1ba-b2a524376ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c81550c8-cc49-4036-a1ba-b2a524376ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd4b3a-3076-41ab-a42b-9d4abea3e5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (badd4b3a-3076-41ab-a42b-9d4abea3e5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c964b76-790b-40f9-accf-7f963dd928ce', 'volume_name': 'volume-9c964b76-790b-40f9-accf-7f963dd928ce', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63895014-42e5-49f3-acdb-78ae1d3e33b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63895014-42e5-49f3-acdb-78ae1d3e33b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8b9935-bea3-4acd-9026-b03a0b1b3202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:00 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume 9c964b76-790b-40f9-accf-7f963dd928ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c964b76-790b-40f9-accf-7f963dd928ce', 'volume_size': 1} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2" returned: 0 in 0.476s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:00 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info Nov 05 11:14:00 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:00 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:00 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f Nov 05 11:14:00 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:01 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:01 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info is being set with open permissions: ugo+rw Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:01 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info Nov 05 11:14:01 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:01 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" returned: 0 in 0.288s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f" released by "delete_volume" :: held 0.820s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Created reservations ['39f1ce32-0c4b-4473-b19f-32ab133ead99', '76839eea-6d5f-440c-a49d-85208fa1f297', '2af3d300-8bdf-4c9a-a763-75b0c54be6f3', '6005ea8c-4267-4089-b856-01b40c6556b2'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:01 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:01 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:01 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.info" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.745s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.495s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-181350892',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912b0991-cf0b-4020-8921-bebb7299019c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume 912b0991-cf0b-4020-8921-bebb7299019c {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:01 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:01 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c 1073741824 Nov 05 11:14:01 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-07872b32-b0dc-480f-bc6b-1d98c91fbda6 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:14:01 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-1083451a-7d29-4efc-9550-489628768df2-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:01 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Deleted volume successfully. Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-1083451a-7d29-4efc-9550-489628768df2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58d46565-e541-4c2e-b99c-e2c46748bcaf tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-90c22bd5-d87e-43a9-87a3-e9dfe0f9626f-delete_volume" released by "delete_volume" :: held 1.513s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-1083451a-7d29-4efc-9550-489628768df2" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1083451a-7d29-4efc-9550-489628768df2" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot 1083451a-7d29-4efc-9550-489628768df2 of volume 93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac6c0770-0030-48a7-8f59-67e42a689619]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:01 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 Nov 05 11:14:01 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:01 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c 1073741824" returned: 0 in 0.505s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:01 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:01 devstack sudo[106747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c Nov 05 11:14:01 devstack sudo[106747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2" returned: 0 in 0.405s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-93fe5b26-6334-4bc1-9417-02734d5a071b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6019a3-357a-4b97-9421-ba27b30adead]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106747]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c" returned: 0 in 0.291s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.170s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1740349049',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9788712-db3f-4a7b-99a0-e00c4f3d049f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume a9788712-db3f-4a7b-99a0-e00c4f3d049f {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:02 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b Nov 05 11:14:02 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f 1073741824 Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b12159-d720-4f71-87ad-d82965462436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912b0991-cf0b-4020-8921-bebb7299019c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:02 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64225a77-3413-490a-87d0-f26844c403b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:02 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-912b0991-cf0b-4020-8921-bebb7299019c (912b0991-cf0b-4020-8921-bebb7299019c): created successfully Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64225a77-3413-490a-87d0-f26844c403b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (182abfdd-1028-44b2-b410-52453e4e10e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:02 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-49152286-1ee3-407e-b978-f1e4db69c809 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-cc338bf2-1c1b-462d-a8ee-81695a568303-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-cc338bf2-1c1b-462d-a8ee-81695a568303-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-quobyte-cc338bf2-1c1b-462d-a8ee-81695a568303" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-cc338bf2-1c1b-462d-a8ee-81695a568303" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[535b3a21-e0e6-4153-85d0-04a68ba147e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 Nov 05 11:14:02 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b" returned: 0 in 0.536s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 Nov 05 11:14:02 devstack sudo[106765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f 1073741824" returned: 0 in 0.565s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f Nov 05 11:14:02 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:02 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:02 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:02 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303 Nov 05 11:14:02 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:03 devstack sudo[106765]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2" returned: 0 in 0.440s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:03 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f" returned: 0 in 0.314s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.523s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:13:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1988923293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5eb27b68-1c72-4158-970e-d2a5d7a07993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:13:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:13:59Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume 5eb27b68-1c72-4158-970e-d2a5d7a07993 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:03 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2 Nov 05 11:14:03 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:03 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9488d4c-6848-4b76-b6ef-419ae0dc8862) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:03 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 1073741824 Nov 05 11:14:03 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44ad974-02bb-482b-8828-e3067c02194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:03 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f (a9788712-db3f-4a7b-99a0-e00c4f3d049f): created successfully Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44ad974-02bb-482b-8828-e3067c02194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (2903a514-d903-449a-83ef-618a0ab3da74) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b125fc3a-4219-4bac-9c55-29c700d9a636 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:14:03 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cc338bf2-1c1b-462d-a8ee-81695a568303" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-cc338bf2-1c1b-462d-a8ee-81695a568303" released by "delete_volume" :: held 0.854s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Created reservations ['42e92737-a5cd-46ec-b081-a3b7169a26c1', '68dc49af-361d-4148-a3da-2c53c3959ee8', 'aec67794-e4b2-4440-a8ba-5a57915ee55d', 'e8740009-842f-4757-9874-6505455db622'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:03 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b.1083451a-7d29-4efc-9550-489628768df2" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:03 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1083451a-7d29-4efc-9550-489628768df2" released by "_delete_snapshot" :: held 1.891s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" released by "delete_snapshot" :: held 1.924s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-ace2417b-5dcb-4ae6-9e95-0879faaf421c-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-ace2417b-5dcb-4ae6-9e95-0879faaf421c-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "cinder-quobyte-ace2417b-5dcb-4ae6-9e95-0879faaf421c" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Created reservations ['81553651-4828-4952-94a2-dfedb9a93027', 'bf6faced-77d0-4c6e-a0c5-691cd7367003', 'a5e27deb-85b9-4ef6-9fed-c9c7a999814e', '1d7feb19-b2b6-4b95-844c-607f2588ecee'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-ace2417b-5dcb-4ae6-9e95-0879faaf421c" acquired by "delete_volume" :: waited 0.037s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4844789d-8635-4677-84ea-a78f5d699c23]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:03 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 1073741824" returned: 0 in 0.652s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-9becb763-ec4c-4dce-adb8-d1e4712f6180 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-1083451a-7d29-4efc-9550-489628768df2-delete_snapshot" released by "delete_snapshot" :: held 2.257s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:03 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:03 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Deleted volume successfully. Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:03 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 Nov 05 11:14:03 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:03 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7587e118-793a-475e-bdc7-057bae16a467 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-cc338bf2-1c1b-462d-a8ee-81695a568303-delete_volume" released by "delete_volume" :: held 1.535s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:03 devstack sudo[106793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c Nov 05 11:14:03 devstack sudo[106793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:04 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993" returned: 0 in 0.283s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.936s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1771284286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11245068-5769-4d93-bb47-224e3feee7f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:00Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume 11245068-5769-4d93-bb47-224e3feee7f1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:04 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4bc314d2-0d57-43d3-9279-dea05b8bd10e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5eb27b68-1c72-4158-970e-d2a5d7a07993', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:04 devstack sudo[106801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 1073741824 Nov 05 11:14:04 devstack sudo[106801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a83a73d-6350-45ac-9635-a0b58e32c0eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:04 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 (5eb27b68-1c72-4158-970e-d2a5d7a07993): created successfully Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6a83a73d-6350-45ac-9635-a0b58e32c0eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (7cc559b6-7a01-4316-aa5c-8b03336b00ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:04 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0e744e59-ca1d-4304-9322-c2c156b14ed8 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:14:04 devstack sudo[106793]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c" returned: 0 in 0.504s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:04 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c Nov 05 11:14:04 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:04 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ace2417b-5dcb-4ae6-9e95-0879faaf421c" returned: 0 in 0.287s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-quobyte-ace2417b-5dcb-4ae6-9e95-0879faaf421c" released by "delete_volume" :: held 0.851s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Created reservations ['e945bcc4-f9d9-4ee2-8d09-709504e3b134', 'bfed18fa-41fb-4b79-a24e-038e3b199ee9', '852243a9-a4e6-48cb-b19f-3143ead84505', '962e19f7-cae4-4fde-a726-8363478255f5'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:04 devstack sudo[106801]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 1073741824" returned: 0 in 0.495s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:04 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:04 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:04 devstack sudo[106812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 Nov 05 11:14:04 devstack sudo[106812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-93fe5b26-6334-4bc1-9417-02734d5a071b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-93fe5b26-6334-4bc1-9417-02734d5a071b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:04 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" acquired by "delete_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:05 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d618cbf1-2ee4-43c8-9148-d4261db0e485]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.385s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:05 devstack sudo[106812]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Deleted volume successfully. Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1" returned: 0 in 0.403s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.627s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-688163958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7d422f8-131d-4d48-930c-54ce35cf4bb9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b1792a7ae2164e10a6d1f904ed9b61a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:00Z,use_quota=True,user_id='853389e4ddf24b52a95bcf1e4155bb23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Creating volume d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:05 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faf18e30-b897-4854-b118-625f7701795c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11245068-5769-4d93-bb47-224e3feee7f1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:05 devstack sudo[106818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 1073741824 Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dadc3-e1ef-4fe6-a67f-9d1981397a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:05 devstack sudo[106818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-87d90fcd-113d-48c0-ad0c-46dba2254a18 tempest-CreateVolumesFromImageTest-170045745 None] Lock "cinder-ace2417b-5dcb-4ae6-9e95-0879faaf421c-delete_volume" released by "delete_volume" :: held 1.603s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:05 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-11245068-5769-4d93-bb47-224e3feee7f1 (11245068-5769-4d93-bb47-224e3feee7f1): created successfully Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c65dadc3-e1ef-4fe6-a67f-9d1981397a57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (4f565fe6-c8b1-4714-87bb-eb0ccdd51863) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:05 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5134b714-9a03-44a9-bb8c-818733842523 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:14:05 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b Nov 05 11:14:05 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:05 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b" returned: 0 in 0.479s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:05 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b Nov 05 11:14:05 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:05 devstack sudo[106818]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 1073741824" returned: 0 in 0.536s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:05 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 Nov 05 11:14:05 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:05 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-93fe5b26-6334-4bc1-9417-02734d5a071b" returned: 0 in 0.329s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:05 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-93fe5b26-6334-4bc1-9417-02734d5a071b" released by "delete_volume" :: held 0.927s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Created reservations ['de3add09-ab11-48ba-a02c-98b592e8c957', '5310de9d-caab-4140-8253-e5fd2cef305a', '7748d79b-fbe6-4983-8241-1c9924bec21c', 'd0830866-41e7-47a7-bb9c-3441299ebb0c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:06 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9" returned: 0 in 0.287s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.313s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-686595790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c964b76-790b-40f9-accf-7f963dd928ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e97b9c61fd454a09ac43846f008555b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:01Z,use_quota=True,user_id='2f7811939d754c43aa5451963ba8276e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Creating volume 9c964b76-790b-40f9-accf-7f963dd928ce {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:06 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aefa0c74-1dbb-4797-ab3e-2ea487458550) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:06 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce 1073741824 Nov 05 11:14:06 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747298b4-3aa8-430f-be93-6b035276a77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:06 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Volume volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 (d7d422f8-131d-4d48-930c-54ce35cf4bb9): created successfully Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (747298b4-3aa8-430f-be93-6b035276a77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Flow 'volume_create_manager' (070045a6-0fd3-4af0-a540-494083865437) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-e24c9f6b-2959-4749-b170-e9abbc9f483a tempest-CinderUnicodeTest-37177935 None] Created volume successfully. Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:06 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:06 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:06 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.346s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-876d41f9-5c11-40e5-80d6-a852a65850e6 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-93fe5b26-6334-4bc1-9417-02734d5a071b-delete_volume" released by "delete_volume" :: held 1.685s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:06 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce 1073741824" returned: 0 in 0.594s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:06 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce Nov 05 11:14:06 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:07 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce" returned: 0 in 0.332s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] <== create_volume: return (977ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.980s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.182s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a8b9935-bea3-4acd-9026-b03a0b1b3202) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c964b76-790b-40f9-accf-7f963dd928ce', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0937f096-0831-4172-84a1-aa8b56cb9e42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Creating offline snapshot 209571fe-23fa-41cd-8be3-37d1c7e71c5e of volume d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:07 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Volume volume-9c964b76-790b-40f9-accf-7f963dd928ce (9c964b76-790b-40f9-accf-7f963dd928ce): created successfully Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0937f096-0831-4172-84a1-aa8b56cb9e42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Flow 'volume_create_manager' (16ae88bc-2382-4b91-9831-7eaca343b4fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[79eb8b58-bb02-4415-ae78-397a7ade2879]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:07 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-06d8ab77-c1f0-414e-b5a8-9fa011711f6d tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created volume successfully. Nov 05 11:14:07 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 Nov 05 11:14:07 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-9c964b76-790b-40f9-accf-7f963dd928ce-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-9c964b76-790b-40f9-accf-7f963dd928ce-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:07 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9" returned: 0 in 0.464s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-9c964b76-790b-40f9-accf-7f963dd928ce" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:07 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e 1G Nov 05 11:14:07 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-9c964b76-790b-40f9-accf-7f963dd928ce" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84e221-5372-4e26-8584-b72b985574e0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:07 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce Nov 05 11:14:07 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (e3514cb7-0718-41d6-bc74-369fd9b2b85b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f34b31-5b03-4981-96d5-c9497e26c800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6f34b31-5b03-4981-96d5-c9497e26c800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271277797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1c82bf-12f0-479d-a53c-d9b08e9f4852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:08Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95e9ce3-0001-495c-bdf8-b37a4438999b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e95e9ce3-0001-495c-bdf8-b37a4438999b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb75fa2-b5a5-4a60-9b76-df4fedf4e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb75fa2-b5a5-4a60-9b76-df4fedf4e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c1c82bf-12f0-479d-a53c-d9b08e9f4852', 'volume_name': 'volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b65f3b-4e55-4e4c-a3bb-088016a96c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55b65f3b-4e55-4e4c-a3bb-088016a96c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c0c9b-0fb2-4955-9f3d-282bc1593640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:07 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Volume 4c1c82bf-12f0-479d-a53c-d9b08e9f4852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852', 'volume_size': 1} Nov 05 11:14:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:08 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e 1G" returned: 0 in 0.597s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:08 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e Nov 05 11:14:08 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:08 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce" returned: 0 in 0.561s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:08 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce Nov 05 11:14:08 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:08 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:08 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e is being set with open permissions: ugo+rw Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:08 devstack sudo[106881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e Nov 05 11:14:08 devstack sudo[106881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:08 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9c964b76-790b-40f9-accf-7f963dd928ce" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-9c964b76-790b-40f9-accf-7f963dd928ce" released by "delete_volume" :: held 0.916s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['9c54e792-31f4-46e7-9329-2df978eadcc4', '2ca5bfc0-cf67-47f3-b360-c314ac80d434', 'a43f74f9-3d1b-47fa-bb4e-f7ff58a9b265', 'b30c61bb-eb96-4a2f-bb18-558b68030e26'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:08 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:08 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:08 devstack sudo[106881]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:08 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info Nov 05 11:14:08 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:09 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ff4f642c-e3e3-4988-a87c-9035be77af73 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-9c964b76-790b-40f9-accf-7f963dd928ce-delete_volume" released by "delete_volume" :: held 1.553s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:09 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info" returned: 0 in 0.286s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:09 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info is being set with open permissions: ugo+rw Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:09 devstack sudo[106890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info Nov 05 11:14:09 devstack sudo[106890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:09 devstack sudo[106890]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.info" returned: 0 in 0.247s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.363s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.431s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1271277797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c1c82bf-12f0-479d-a53c-d9b08e9f4852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:08Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Creating volume 4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:09 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:09 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 1073741824 Nov 05 11:14:09 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-327d1d58-9e73-4209-8208-6947094bef87 tempest-CinderUnicodeTest-37177935 None] Create snapshot completed successfully Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-11245068-5769-4d93-bb47-224e3feee7f1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-11245068-5769-4d93-bb47-224e3feee7f1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-11245068-5769-4d93-bb47-224e3feee7f1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-11245068-5769-4d93-bb47-224e3feee7f1" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[09173b10-b02c-4191-af90-da9ee1253c79]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:09 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 1073741824" returned: 0 in 0.558s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:10 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 Nov 05 11:14:10 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:10 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 Nov 05 11:14:10 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-209571fe-23fa-41cd-8be3-37d1c7e71c5e-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-209571fe-23fa-41cd-8be3-37d1c7e71c5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-quobyte-209571fe-23fa-41cd-8be3-37d1c7e71c5e" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-209571fe-23fa-41cd-8be3-37d1c7e71c5e" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Deleting offline snapshot 209571fe-23fa-41cd-8be3-37d1c7e71c5e of volume d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] snapshot_file for this snap is: volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf945489-3a41-4d6e-b72d-ddf66c92ec5f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:10 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" returned: 0 in 0.331s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f5c0c9b-0fb2-4955-9f3d-282bc1593640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:10 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8ea81b-6897-41f9-8feb-f45d6e05c49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1" returned: 0 in 0.462s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:10 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e Nov 05 11:14:10 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:10 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Volume volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 (4c1c82bf-12f0-479d-a53c-d9b08e9f4852): created successfully Nov 05 11:14:10 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1 Nov 05 11:14:10 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf8ea81b-6897-41f9-8feb-f45d6e05c49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (e3514cb7-0718-41d6-bc74-369fd9b2b85b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:10 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d3d5fe16-623c-4511-b2f6-fd01e1339084 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:14:10 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-11245068-5769-4d93-bb47-224e3feee7f1" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-11245068-5769-4d93-bb47-224e3feee7f1" released by "delete_volume" :: held 0.800s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:10 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e" returned: 0 in 0.451s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[b275bc11-5b28-47e9-bc2e-041f80e5ac97]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['023119a9-04c8-4406-865f-fc1691cd4c63', '915baace-33b5-4e80-8c7f-9f1609da7380', '07da31df-ca10-4934-8a17-40eb93421718', '9e61250d-4322-4bd4-af70-04fb0bb117ad'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:10 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 Nov 05 11:14:10 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:10 devstack sudo[106917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:10 devstack sudo[106917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-5eb27b68-1c72-4158-970e-d2a5d7a07993-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-5eb27b68-1c72-4158-970e-d2a5d7a07993-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:11 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-5eb27b68-1c72-4158-970e-d2a5d7a07993" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:11 devstack sudo[106917]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9" returned: 0 in 0.597s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:11 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e Nov 05 11:14:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:11 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-5eb27b68-1c72-4158-970e-d2a5d7a07993" acquired by "delete_volume" :: waited 0.044s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d8e57a3-3165-460f-a740-811400d36a7f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-1105250e-344f-438b-ae2c-4a04aa12c283 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-11245068-5769-4d93-bb47-224e3feee7f1-delete_volume" released by "delete_volume" :: held 1.600s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot efef79bd-c897-4882-8a70-21aa6e13b2e1 of volume 4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[53f62000-54af-411f-b84e-1acb64d4b62f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:11 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 Nov 05 11:14:11 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 Nov 05 11:14:11 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:11 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e Nov 05 11:14:11 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:11 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993 Nov 05 11:14:11 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:11 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" returned: 0 in 0.487s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:12 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 1G Nov 05 11:14:12 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:12 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9.209571fe-23fa-41cd-8be3-37d1c7e71c5e" returned: 0 in 0.357s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-209571fe-23fa-41cd-8be3-37d1c7e71c5e" released by "_delete_snapshot" :: held 1.977s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" released by "delete_snapshot" :: held 2.007s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:12 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5eb27b68-1c72-4158-970e-d2a5d7a07993" returned: 0 in 0.381s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-5eb27b68-1c72-4158-970e-d2a5d7a07993" released by "delete_volume" :: held 0.869s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Created reservations ['3dbd21ca-7ef7-4afa-b9f2-2f0dd619c3fb', 'cd683722-95d2-4433-bad7-f35de7da6367', 'a5b3a2eb-7da1-4828-8138-8d34e8a4c823', '3ae9fd28-8ae0-422f-b757-de9a70629a96'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['0cc0d220-2d65-48f9-9664-378a868921c0', '2c3b85da-010e-46fe-bd62-37a26fb63c7f', 'cc95dd47-0bfb-4004-8c4a-3f45247bc133', '5cb99d2b-2b3c-42b8-a9c0-5f97193e83af'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Delete snapshot completed successfully. Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f3de1b81-2216-44e4-aaca-1093e73a1def tempest-CinderUnicodeTest-37177935 None] Lock "cinder-209571fe-23fa-41cd-8be3-37d1c7e71c5e-delete_snapshot" released by "delete_snapshot" :: held 2.280s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:12 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:12 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:12 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 1G" returned: 0 in 0.584s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:12 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 Nov 05 11:14:12 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:12 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-74897b26-736b-43aa-b790-8822f475467c tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-5eb27b68-1c72-4158-970e-d2a5d7a07993-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:12 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1" returned: 0 in 0.329s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:12 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 is being set with open permissions: ugo+rw Nov 05 11:14:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:12 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 Nov 05 11:14:12 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:13 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:13 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info Nov 05 11:14:13 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-a9788712-db3f-4a7b-99a0-e00c4f3d049f-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-a9788712-db3f-4a7b-99a0-e00c4f3d049f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:13 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-d7d422f8-131d-4d48-930c-54ce35cf4bb9-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info" returned: 0 in 0.324s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:13 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info is being set with open permissions: ugo+rw Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "cinder-d7d422f8-131d-4d48-930c-54ce35cf4bb9-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:13 devstack sudo[106966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info Nov 05 11:14:13 devstack sudo[106966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-a9788712-db3f-4a7b-99a0-e00c4f3d049f" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-a9788712-db3f-4a7b-99a0-e00c4f3d049f" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" acquired by "delete_volume" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[896c361d-4d0e-46b0-b11d-4c1a0a030e0e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9289cbde-2b99-4683-ac64-9e47aa204d50]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:13 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f Nov 05 11:14:13 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:13 devstack sudo[106966]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.info" returned: 0 in 0.310s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:13 devstack sudo[106969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 Nov 05 11:14:13 devstack sudo[106969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.440s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5cb6c7dd-0832-46c4-a287-f19e77cd5057 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:14:14 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f" returned: 0 in 0.471s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:14 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f Nov 05 11:14:14 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:14 devstack sudo[106969]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:14 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9 Nov 05 11:14:14 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:14 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-a9788712-db3f-4a7b-99a0-e00c4f3d049f" returned: 0 in 0.309s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-a9788712-db3f-4a7b-99a0-e00c4f3d049f" released by "delete_volume" :: held 0.891s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:14 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d7d422f8-131d-4d48-930c-54ce35cf4bb9" returned: 0 in 0.305s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-d7d422f8-131d-4d48-930c-54ce35cf4bb9" released by "delete_volume" :: held 0.883s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-efef79bd-c897-4882-8a70-21aa6e13b2e1-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-efef79bd-c897-4882-8a70-21aa6e13b2e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['008f99e2-c8e1-44c2-a889-da8564093333', 'd2f016e7-ac4c-444f-b065-4578b97364c7', '4a4a98a7-2413-44d2-bca7-dcf8ce961188', '83c429ba-538e-4d6d-a70f-d29ae5f3cf9b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-efef79bd-c897-4882-8a70-21aa6e13b2e1" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=206,cinder:UPDATE=270,cinder:INSERT=74,cinder:DELETE=23 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Created reservations ['5deb4487-820c-41de-8e5b-0c0d5e305fe0', 'c2cae09a-f9e5-4865-b40c-e5099b67e407', '407082e2-c182-4a0e-a818-fcfb08c0e4bb', '7bba1640-01cb-41d1-a41c-7c506a54fa7e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-efef79bd-c897-4882-8a70-21aa6e13b2e1" acquired by "_delete_snapshot" :: waited 0.042s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot efef79bd-c897-4882-8a70-21aa6e13b2e1 of volume 4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b1d113c-1cf9-4f40-99fd-426f2cb4ef30]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:14 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:14 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:14 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 Nov 05 11:14:14 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:14 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:14 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:15 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.325s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a81c18e7-a9f1-4f1f-98bf-019cda979f4e tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-a9788712-db3f-4a7b-99a0-e00c4f3d049f-delete_volume" released by "delete_volume" :: held 1.702s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:15 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Deleted volume successfully. Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=211,cinder:UPDATE=288,cinder:DELETE=28,cinder:INSERT=71 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2b7ffb9d-53ad-400d-ba22-135b7036bbce tempest-CinderUnicodeTest-37177935 None] Lock "cinder-d7d422f8-131d-4d48-930c-54ce35cf4bb9-delete_volume" released by "delete_volume" :: held 1.706s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:15 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1" returned: 0 in 0.525s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd0ac71c-9c10-4ae0-8970-7555f58b51ce]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:15 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 Nov 05 11:14:15 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:15 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" returned: 0 in 0.421s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-912b0991-cf0b-4020-8921-bebb7299019c-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:15 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 Nov 05 11:14:15 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-912b0991-cf0b-4020-8921-bebb7299019c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-912b0991-cf0b-4020-8921-bebb7299019c" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-912b0991-cf0b-4020-8921-bebb7299019c" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "cinder-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[103572c0-775c-4ac3-b648-fe4a28241fd3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "cinder-quobyte-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" acquired by "delete_volume" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1fe64c-18b1-4c51-8a31-82683a98de7c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:16 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c Nov 05 11:14:16 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:16 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 Nov 05 11:14:16 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:16 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1" returned: 0 in 0.556s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:16 devstack sudo[107011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1 Nov 05 11:14:16 devstack sudo[107011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:16 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c" returned: 0 in 0.504s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:16 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c Nov 05 11:14:16 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:16 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" returned: 0 in 0.568s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:16 devstack sudo[107011]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852.efef79bd-c897-4882-8a70-21aa6e13b2e1" returned: 0 in 0.343s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3 Nov 05 11:14:16 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-efef79bd-c897-4882-8a70-21aa6e13b2e1" released by "_delete_snapshot" :: held 2.003s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" released by "delete_snapshot" :: held 2.054s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:16 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-912b0991-cf0b-4020-8921-bebb7299019c" returned: 0 in 0.340s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Created reservations ['36f733ae-7d8f-4d5b-bbd9-78a001fc29a1', '628096ce-8399-43c2-8b8d-bd8d88d171f7', '9eb71268-8b60-4967-a5ad-b77b4143a72f', 'c050b606-192f-4ab5-bc41-3a20d21a60b9'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-912b0991-cf0b-4020-8921-bebb7299019c" released by "delete_volume" :: held 0.924s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:16 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-2bcf60e2-5bd1-493f-8e62-57b438f3b973 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-efef79bd-c897-4882-8a70-21aa6e13b2e1-delete_snapshot" released by "delete_snapshot" :: held 2.281s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['6f38673b-2418-4f26-95f7-96b027db9d2d', 'ccfb8db5-47f6-4124-a145-4de56b54646f', '271e4a3d-de86-42a8-b58b-66f65f512ba9', '2f0a632f-f5f5-465d-8434-eab4c8a9d751'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:16 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" returned: 0 in 0.335s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "cinder-quobyte-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3" released by "delete_volume" :: held 0.965s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:17 devstack sudo[107028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:17 devstack sudo[107028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Created reservations ['908b3c09-c487-40ce-9dea-65a0a7143f8c', '1e9b5ddf-7f42-4512-891a-df8e5366831a', '1d8b12b9-ad0a-4f63-bad6-811eb9b5d810', '57d29e08-c696-4b73-b892-1830c462b352'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-b0af992a-f8b2-4255-9caf-a471fe3c07f6-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-b0af992a-f8b2-4255-9caf-a471fe3c07f6-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "cinder-quobyte-b0af992a-f8b2-4255-9caf-a471fe3c07f6" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-b0af992a-f8b2-4255-9caf-a471fe3c07f6" acquired by "delete_volume" :: waited 0.047s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:17 devstack sudo[107030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:17 devstack sudo[107030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2034a4d1-5b80-49e1-ab75-2df1ef7659cb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:17 devstack sudo[107028]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.385s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-beab39f0-fba1-40a9-9293-da5298c32ed7 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-912b0991-cf0b-4020-8921-bebb7299019c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:17 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 Nov 05 11:14:17 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:17 devstack sudo[107030]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Deleted volume successfully. Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-12d810f6-26d2-43ca-a2f8-5d0bffc11ee6 tempest-CinderUnicodeTest-37177935 None] Lock "cinder-c7dd7879-9c93-489f-9e91-4c4c8ae7bdc3-delete_volume" released by "delete_volume" :: held 1.772s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:17 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-4c1c82bf-12f0-479d-a53c-d9b08e9f4852-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:17 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6 Nov 05 11:14:17 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "cinder-4c1c82bf-12f0-479d-a53c-d9b08e9f4852-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[02dd6a5e-b0ac-4ab9-8cee-c8dd751b1732]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:18 devstack sudo[107041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 Nov 05 11:14:18 devstack sudo[107041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:18 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b0af992a-f8b2-4255-9caf-a471fe3c07f6" returned: 0 in 0.373s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-quobyte-b0af992a-f8b2-4255-9caf-a471fe3c07f6" released by "delete_volume" :: held 0.944s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Created reservations ['db8ea761-0997-46e0-a8fb-414f79f05355', '108d67ae-8707-429a-9ab0-5c2b527a7149', '02e848e8-ce9a-4bbc-8f38-f13d9d4f466d', 'e27fcc34-630e-4358-a939-07b749723c54'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:18 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:18 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:18 devstack sudo[107041]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" returned: 0 in 0.491s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:18 devstack sudo[107050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852 Nov 05 11:14:18 devstack sudo[107050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:18 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.289s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Deleted volume successfully. Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-4284f56c-14e6-4738-85fb-2edf45c550e4 tempest-CreateVolumesFromSourceVolumeTest-606007461 None] Lock "cinder-b0af992a-f8b2-4255-9caf-a471fe3c07f6-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:18 devstack sudo[107050]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4c1c82bf-12f0-479d-a53c-d9b08e9f4852" released by "delete_volume" :: held 0.893s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Created reservations ['c24c25f4-60b8-42f6-b3ee-18f064713ea2', '3d902412-a640-4ac0-a915-1230eaab1941', '79eb4449-4b07-4d1a-8507-acf2041edc47', '67d11c78-d89a-4b1e-81ef-f4a781bd8b19'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:19 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:19 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:19 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.406s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-7ce5525c-4f49-45ba-a551-9b4d39ce1e1f tempest-ProjectMemberTests-1322633992 None] Lock "cinder-4c1c82bf-12f0-479d-a53c-d9b08e9f4852-delete_volume" released by "delete_volume" :: held 1.570s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (885562bd-be2e-4169-b5e7-cce976d6c23e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7d6e5-a706-42b3-9aa8-9c78bfda5ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04e7d6e5-a706-42b3-9aa8-9c78bfda5ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304278233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee0b5f8-8226-4558-84cb-ea2d51510b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:20Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13462515-24ee-4208-b74d-7cfd59a1fc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13462515-24ee-4208-b74d-7cfd59a1fc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2a5086-d51d-402a-a2ba-222f9595b4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c2a5086-d51d-402a-a2ba-222f9595b4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ee0b5f8-8226-4558-84cb-ea2d51510b48', 'volume_name': 'volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cd1bbc-ffee-4cf8-93fb-48621127d7e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07cd1bbc-ffee-4cf8-93fb-48621127d7e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287e4f5-dd81-4321-8416-f89ba39970a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Volume 7ee0b5f8-8226-4558-84cb-ea2d51510b48: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48', 'volume_size': 1} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-304278233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ee0b5f8-8226-4558-84cb-ea2d51510b48,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:20Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Creating volume 7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:19 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:19 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 1073741824 Nov 05 11:14:19 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:20 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 1073741824" returned: 0 in 0.692s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:20 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 Nov 05 11:14:20 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:21 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48" returned: 0 in 0.380s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (1146ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.150s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f287e4f5-dd81-4321-8416-f89ba39970a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c22e0-cea6-4c6f-aa9d-eb02ff82283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:21 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Volume volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 (7ee0b5f8-8226-4558-84cb-ea2d51510b48): created successfully Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e2c22e0-cea6-4c6f-aa9d-eb02ff82283f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:21 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (885562bd-be2e-4169-b5e7-cce976d6c23e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a06ba0b9-ee7f-4d63-8354-99b0dc64daa7 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot 001bb1a7-a0b3-4a66-b43f-886f0541c6c2 of volume 7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[32014aa1-e993-4ffa-bc6a-d4acd430113d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:22 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 Nov 05 11:14:22 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:22 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48" returned: 0 in 0.451s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:22 devstack sudo[107073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 1G Nov 05 11:14:22 devstack sudo[107073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:23 devstack sudo[107073]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 1G" returned: 0 in 0.630s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:23 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 Nov 05 11:14:23 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (26668c0f-9486-44da-9c4c-1c36b5dc8955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b63d0c-13e7-439f-af26-2d28e1e11631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45b63d0c-13e7-439f-af26-2d28e1e11631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965217920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bbd1e6-e898-440f-8165-58cf51f43d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:23Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86528af-4615-4331-a5d7-10dcbd8d3ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e86528af-4615-4331-a5d7-10dcbd8d3ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaecab27-81af-47a5-bb54-31a717853b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aaecab27-81af-47a5-bb54-31a717853b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3bbd1e6-e898-440f-8165-58cf51f43d27', 'volume_name': 'volume-d3bbd1e6-e898-440f-8165-58cf51f43d27', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2757f19-ab86-42de-a5fd-3c5a4b477229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2757f19-ab86-42de-a5fd-3c5a4b477229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac043517-db21-46e6-8bad-25bda6c237bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Volume d3bbd1e6-e898-440f-8165-58cf51f43d27: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3bbd1e6-e898-440f-8165-58cf51f43d27', 'volume_size': 1} Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:23 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2" returned: 0 in 0.360s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:23 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 is being set with open permissions: ugo+rw Nov 05 11:14:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:23 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 Nov 05 11:14:23 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:24 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2" returned: 0 in 0.286s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:24 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info Nov 05 11:14:24 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:24 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info" returned: 0 in 0.309s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:24 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info is being set with open permissions: ugo+rw Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:24 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info Nov 05 11:14:24 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:24 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.info" returned: 0 in 0.317s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.467s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.063s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-965217920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3bbd1e6-e898-440f-8165-58cf51f43d27,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:23Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Creating volume d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:24 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:24 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 1073741824 Nov 05 11:14:24 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6b043324-dce0-4299-932c-13370ef60735 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:14:25 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 1073741824" returned: 0 in 0.570s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:25 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 Nov 05 11:14:25 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-001bb1a7-a0b3-4a66-b43f-886f0541c6c2-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-001bb1a7-a0b3-4a66-b43f-886f0541c6c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-001bb1a7-a0b3-4a66-b43f-886f0541c6c2" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-001bb1a7-a0b3-4a66-b43f-886f0541c6c2" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot 001bb1a7-a0b3-4a66-b43f-886f0541c6c2 of volume 7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6262a1b4-ce7c-4497-a35c-f4f967a13d00]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:25 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27" returned: 0 in 0.316s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac043517-db21-46e6-8bad-25bda6c237bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3bbd1e6-e898-440f-8165-58cf51f43d27', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcc4656-b85f-473a-b6a2-dcc905ec15f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:25 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Volume volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 (d3bbd1e6-e898-440f-8165-58cf51f43d27): created successfully Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bcc4656-b85f-473a-b6a2-dcc905ec15f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:25 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 Nov 05 11:14:25 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:25 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (26668c0f-9486-44da-9c4c-1c36b5dc8955) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3a9028d1-1efa-4f67-803a-50877ec92c10 tempest-ProjectReaderTests-1253151684 None] Created volume successfully. Nov 05 11:14:26 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2" returned: 0 in 0.456s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e719e0a7-138b-43fc-ab6a-61851caa3dbc]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:26 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 Nov 05 11:14:26 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:26 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48" returned: 0 in 0.530s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:26 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 Nov 05 11:14:26 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:26 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Creating offline snapshot 57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 of volume d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc317e5c-f2cc-47a5-9637-ca2ea0483890]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:27 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:27 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 Nov 05 11:14:27 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:27 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2 Nov 05 11:14:27 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Flow 'volume_create_manager' (2a1c7768-79f2-4a30-af66-d9294ca27fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2e9f77-d7df-4fe2-a9fd-3d7d6817ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc2e9f77-d7df-4fe2-a9fd-3d7d6817ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a653d0f-c34c-4c4a-8621-112a7310a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ded2b5a90347a79543126a6b5536cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:27Z,use_quota=True,user_id='c23bb7835a3546408c5d925248eb8c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed2f2e1-1edb-46e7-9526-ec588f47d005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ed2f2e1-1edb-46e7-9526-ec588f47d005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7e1dee-7035-4c3e-b707-9b366135abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.image.glance [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Creating Keystone auth plugin from conf {{(pid=87369) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 05 11:14:27 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27" returned: 0 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:27 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48.001bb1a7-a0b3-4a66-b43f-886f0541c6c2" returned: 0 in 0.307s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:27 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 1G Nov 05 11:14:27 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-001bb1a7-a0b3-4a66-b43f-886f0541c6c2" released by "_delete_snapshot" :: held 1.976s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" released by "delete_snapshot" :: held 2.013s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Created reservations ['b4f19bdc-44c3-4dc7-845c-1728bbb6fa5c', '92146a65-5056-4997-977a-0f10a5e06ef6', 'f03aa35c-a800-4f59-8805-c5e9f4cade2c', '8f4114ab-8044-4435-917b-86d4a0b307f9'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:27 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-34b28ada-f399-4c29-9b76-5fe822600b06 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-001bb1a7-a0b3-4a66-b43f-886f0541c6c2-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf7e1dee-7035-4c3e-b707-9b366135abf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0a653d0f-c34c-4c4a-8621-112a7310a2b1', 'volume_name': 'volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1', 'volume_size': 1, 'image_id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aa3ff718bf3513ebcf76a200e2af565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ded2b5a90347a79543126a6b5536cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46631a73b301060ac70cc12ebb680b6a110dd74ead017ea114e236c682dbfc81b6c1159359c7aaf5470de468d9642adb83baea3207a7a202b431e76d4bc2e5b1', 'id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'created_at': datetime.datetime(2026, 11, 5, 10, 14, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579b0de3-2538-4d2e-946f-fe392bbd2ce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579b0de3-2538-4d2e-946f-fe392bbd2ce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f859ba-a770-47b8-9009-bb6ca89afd3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:27 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1', 'volume_size': 1, 'image_id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aa3ff718bf3513ebcf76a200e2af565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ded2b5a90347a79543126a6b5536cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46631a73b301060ac70cc12ebb680b6a110dd74ead017ea114e236c682dbfc81b6c1159359c7aaf5470de468d9642adb83baea3207a7a202b431e76d4bc2e5b1', 'id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'created_at': datetime.datetime(2026, 11, 5, 10, 14, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf/file', 'properties': {}}, 'image_service': } Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Trying to clone 0a653d0f-c34c-4c4a-8621-112a7310a2b1 from image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf at location (None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}]). {{(pid=87369) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 05 11:14:27 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Image download 0.00 MB at 0.00 MB/s Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e1dc60e-c2f0-44b2-8ecb-3e5ddaa27528]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:28 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 1G" returned: 0 in 0.623s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack sudo[107135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 Nov 05 11:14:28 devstack sudo[107135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 0 in 0.365s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack sudo[107135]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" returned: 0 in 0.318s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:28 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 is being set with open permissions: ugo+rw Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:28 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack sudo[107145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 Nov 05 11:14:28 devstack sudo[107145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 1 in 0.346s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Temporary image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf is fetched for user c23bb7835a3546408c5d925248eb8c59. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-7ee0b5f8-8226-4558-84cb-ea2d51510b48-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:28 devstack sudo[107145]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" returned: 0 in 0.331s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-7ee0b5f8-8226-4558-84cb-ea2d51510b48-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6eb595-656f-4709-bbe7-04043722e3a0]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:28 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info Nov 05 11:14:28 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:28 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:28 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[175e7bb4-41a6-4ed8-85cc-551431fb8f4c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:29 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:29 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 Nov 05 11:14:29 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:29 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info" returned: 0 in 0.461s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info is being set with open permissions: ugo+rw Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:29 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info Nov 05 11:14:29 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:29 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:29 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:29 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48" returned: 0 in 0.661s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.info" returned: 0 in 0.380s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48 Nov 05 11:14:29 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.768s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 1 in 0.491s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:27Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a653d0f-c34c-4c4a-8621-112a7310a2b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f6ded2b5a90347a79543126a6b5536cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:27Z,use_quota=True,user_id='c23bb7835a3546408c5d925248eb8c59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Creating volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:29 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:29 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1073741824 Nov 05 11:14:29 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:29 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5dd92264-af76-4fc3-b68e-2257d2644dd0 tempest-ProjectReaderTests-1253151684 None] Create snapshot completed successfully Nov 05 11:14:29 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7ee0b5f8-8226-4558-84cb-ea2d51510b48" returned: 0 in 0.308s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:29 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-7ee0b5f8-8226-4558-84cb-ea2d51510b48" released by "delete_volume" :: held 1.086s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Created reservations ['45d4a034-7751-438a-a349-23e68abbdf59', '1544c82b-1795-4413-97b2-bd012be769e1', '3ecd0280-167a-430e-b8df-f89a6fc636c4', '7c425a30-b21f-4aec-b482-6fd8e4958745'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:30 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:30 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:30 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1073741824" returned: 0 in 0.634s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:30 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 Nov 05 11:14:30 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:30 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.344s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:30 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Deleting offline snapshot 57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 of volume d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] snapshot_file for this snap is: volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-55a5b38a-f43d-48d4-a8cf-c7cbb5132df3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-7ee0b5f8-8226-4558-84cb-ea2d51510b48-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd21a71f-7544-4e3c-b453-600dbbae513d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:30 devstack sudo[107187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 Nov 05 11:14:30 devstack sudo[107187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:30 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1" returned: 0 in 0.327s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Attempting download of 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf ((None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}])) to volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f8c142-5ef2-4e65-bc84-d357e9e57cc5]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:30 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:31 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7 Nov 05 11:14:31 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:31 devstack sudo[107187]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" returned: 0 in 0.466s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3bbd1e6-e898-440f-8165-58cf51f43d27(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d80f9b-503c-4a9e-a56e-7098dc584b15]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:31 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 Nov 05 11:14:31 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:31 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7" returned: 0 in 0.495s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:31 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7 Nov 05 11:14:31 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:31 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27" returned: 0 in 0.563s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:31 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 Nov 05 11:14:31 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (7ffbf492-26fd-4277-9647-b35d6c0bc0c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197368a-aefd-4ca8-a5eb-f633a3fbf244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5197368a-aefd-4ca8-a5eb-f633a3fbf244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798738354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60611d1-0c0a-4edc-b55b-24f95706e66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:32Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed19447f-9838-4eb6-9884-a932e1ed7683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ed19447f-9838-4eb6-9884-a932e1ed7683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee78258-e03f-4ac5-8d2c-a5f01b4aff4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ee78258-e03f-4ac5-8d2c-a5f01b4aff4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b60611d1-0c0a-4edc-b55b-24f95706e66b', 'volume_name': 'volume-b60611d1-0c0a-4edc-b55b-24f95706e66b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3dff3a-6926-4888-95dd-d8457b11ca36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed3dff3a-6926-4888-95dd-d8457b11ca36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6ebb6-d2fa-4284-ba30-96a255f8f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:31 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Volume b60611d1-0c0a-4edc-b55b-24f95706e66b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b60611d1-0c0a-4edc-b55b-24f95706e66b', 'volume_size': 1} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-798738354',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b60611d1-0c0a-4edc-b55b-24f95706e66b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:32Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Creating volume b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:31 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:31 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7" returned: 1 in 0.622s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_85vl7bs7' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ed658b5-2b82-41bd-b240-7caef2f74216]: (4, 'raw') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:31 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:32 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b 1073741824 Nov 05 11:14:32 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:32 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" returned: 0 in 0.543s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:32 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58 Nov 05 11:14:32 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 0 in 0.431s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:32 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b 1073741824" returned: 0 in 0.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27.57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD Nov 05 11:14:32 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58" released by "_delete_snapshot" :: held 2.024s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" released by "delete_snapshot" :: held 2.077s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:32 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b Nov 05 11:14:32 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Created reservations ['692c8286-ca67-408f-8db1-3352b1e78310', '310eba94-d993-4b10-892e-884bf0a3f8a4', '30c22ea8-0410-44fa-b302-8db29cc4053e', '4287022c-30d0-43d3-a1bf-26016a88719f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:32 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Delete snapshot completed successfully. Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-6935ba8f-c767-4036-b947-69bf4f5892c1 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-57f44a7f-099b-4f2b-a7bd-2a7aff8c3b58-delete_snapshot" released by "delete_snapshot" :: held 2.324s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:32 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD" returned: 1 in 0.473s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf was raw, converting to qcow2 {{(pid=87369) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:32 devstack sudo[107273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 Nov 05 11:14:32 devstack sudo[107273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:32 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b" returned: 0 in 0.321s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ce6ebb6-d2fa-4284-ba30-96a255f8f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b60611d1-0c0a-4edc-b55b-24f95706e66b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7594b6-307b-4d01-a2d3-af097f6fda5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:32 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Volume volume-b60611d1-0c0a-4edc-b55b-24f95706e66b (b60611d1-0c0a-4edc-b55b-24f95706e66b): created successfully Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b7594b6-307b-4d01-a2d3-af097f6fda5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:32 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (7ffbf492-26fd-4277-9647-b35d6c0bc0c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-025f131c-2b53-41dd-b533-1a8c64b15140 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:14:33 devstack sudo[107273]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1" returned: 0 in 0.539s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf_sda239abdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:14:33 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Converted 0.00 MB image at 0.00 MB/s Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:33 devstack sudo[107279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1G Nov 05 11:14:33 devstack sudo[107279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-d3bbd1e6-e898-440f-8165-58cf51f43d27-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-d3bbd1e6-e898-440f-8165-58cf51f43d27-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:33 devstack sudo[107279]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 1G" returned: 0 in 0.481s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Downloaded image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf ((None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}])) to volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1 successfully. {{(pid=87369) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Temporary image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf for user c23bb7835a3546408c5d925248eb8c59 is deleted. {{(pid=87369) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.volume.volume_utils [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Marking volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1 as bootable. {{(pid=87369) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[cac36459-b447-43a7-b6a4-7675aa95d289]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Copying metadata from image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf to 0a653d0f-c34c-4c4a-8621-112a7310a2b1. {{(pid=87369) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 05 11:14:33 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Creating volume glance metadata for volume 0a653d0f-c34c-4c4a-8621-112a7310a2b1 backed by image 9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf with: {'image_id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '9aa3ff718bf3513ebcf76a200e2af565', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87369) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5f859ba-a770-47b8-9009-bb6ca89afd3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1', 'volume_size': 1, 'image_id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '9aa3ff718bf3513ebcf76a200e2af565', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f6ded2b5a90347a79543126a6b5536cf', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '46631a73b301060ac70cc12ebb680b6a110dd74ead017ea114e236c682dbfc81b6c1159359c7aaf5470de468d9642adb83baea3207a7a202b431e76d4bc2e5b1', 'id': '9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf', 'created_at': datetime.datetime(2026, 11, 5, 10, 14, 24, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 5, 10, 14, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/9ff8fe58-a59a-46e4-94d0-e3a3b1787ccf/file', 'properties': {}}, 'image_service': }' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15accb10-8e99-4f65-99b3-55d9d89db7ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:34 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 Nov 05 11:14:34 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Volume volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 (0a653d0f-c34c-4c4a-8621-112a7310a2b1): created successfully Nov 05 11:14:34 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15accb10-8e99-4f65-99b3-55d9d89db7ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Flow 'volume_create_manager' (2a1c7768-79f2-4a30-af66-d9294ca27fcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:34 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-17a85a64-6f3a-4027-9a6e-6e366521d43f tempest-VolumeImageDependencyTests-1908425456 None] Created volume successfully. Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot b8cb01cd-2c31-442d-94b6-0586407e13ca of volume b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1103ef36-e73e-4d86-aa09-b4154fe95391]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:34 devstack sudo[107286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b Nov 05 11:14:34 devstack sudo[107286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:34 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27" returned: 0 in 0.577s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:34 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27 Nov 05 11:14:34 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:34 devstack sudo[107286]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b" returned: 0 in 0.447s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:34 devstack sudo[107297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca 1G Nov 05 11:14:34 devstack sudo[107297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:34 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-d3bbd1e6-e898-440f-8165-58cf51f43d27" returned: 0 in 0.297s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-d3bbd1e6-e898-440f-8165-58cf51f43d27" released by "delete_volume" :: held 1.030s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:34 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Created reservations ['790d0aaf-32f6-4612-9e5f-a9cc9d30bdd2', '677ff07e-4780-4c02-968b-6a2cfb785d30', 'a5b5b01d-0f3d-4e4b-8c14-ecc5e1813c3c', 'eb753c58-d66a-47d6-9136-66d8e9112045'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:35 devstack sudo[107299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:35 devstack sudo[107299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Acquiring lock "cinder-0a653d0f-c34c-4c4a-8621-112a7310a2b1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "cinder-0a653d0f-c34c-4c4a-8621-112a7310a2b1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Acquiring lock "cinder-quobyte-0a653d0f-c34c-4c4a-8621-112a7310a2b1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "cinder-quobyte-0a653d0f-c34c-4c4a-8621-112a7310a2b1" acquired by "delete_volume" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:35 devstack sudo[107297]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccf79d6-5c1c-40cf-a939-50c7a67e033e]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:35 devstack sudo[107299]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca 1G" returned: 0 in 0.668s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.403s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60611d1-0c0a-4edc-b55b-24f95706e66b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Deleted volume successfully. Nov 05 11:14:35 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60611d1-0c0a-4edc-b55b-24f95706e66b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca Nov 05 11:14:35 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f8194bee-e43f-4605-8fea-dc7411646138 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-d3bbd1e6-e898-440f-8165-58cf51f43d27-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:35 devstack sudo[107306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 Nov 05 11:14:35 devstack sudo[107306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:35 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b60611d1-0c0a-4edc-b55b-24f95706e66b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca" returned: 0 in 0.394s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:35 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca is being set with open permissions: ugo+rw Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:35 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca Nov 05 11:14:35 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:35 devstack sudo[107306]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1" returned: 0 in 0.548s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:36 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1 Nov 05 11:14:36 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:36 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca" returned: 0 in 0.364s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:36 devstack sudo[107323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info Nov 05 11:14:36 devstack sudo[107323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:36 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-0a653d0f-c34c-4c4a-8621-112a7310a2b1" returned: 0 in 0.317s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "cinder-quobyte-0a653d0f-c34c-4c4a-8621-112a7310a2b1" released by "delete_volume" :: held 0.943s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Created reservations ['aab32236-e267-4b66-840b-c8d6d58b1ece', '918c4076-d43c-481e-aa20-a2a2bf8254ad', '735869e2-50be-4f48-a65f-14660f08aae9', '8e088929-bf7c-4114-a793-31e1a63d20be'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:36 devstack sudo[107326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:36 devstack sudo[107326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:36 devstack sudo[107323]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info" returned: 0 in 0.374s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:36 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info is being set with open permissions: ugo+rw Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:36 devstack sudo[107328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info Nov 05 11:14:36 devstack sudo[107328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:36 devstack sudo[107326]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.293s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:36 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Deleted volume successfully. Nov 05 11:14:36 devstack sudo[107328]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.info" returned: 0 in 0.277s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.671s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (6e20be80-0f0f-4e38-9af7-ee93b4318f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:36 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3371eb-6685-40a7-bd47-b02c4912dcc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b3371eb-6685-40a7-bd47-b02c4912dcc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213369266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083cc99d-8e22-4a0e-93bb-0efec201e9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:37Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674a68a9-911d-445b-a875-02905050bc78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (674a68a9-911d-445b-a875-02905050bc78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fb0d96-bcea-4f13-84b0-8f15b809a00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7fb0d96-bcea-4f13-84b0-8f15b809a00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '083cc99d-8e22-4a0e-93bb-0efec201e9e4', 'volume_name': 'volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad22e4f-ae24-4f06-8eda-76d315649e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ad22e4f-ae24-4f06-8eda-76d315649e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f6a467-71d4-4d2f-8128-ac1026a40281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:37 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Volume 083cc99d-8e22-4a0e-93bb-0efec201e9e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4', 'volume_size': 1} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-213369266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=083cc99d-8e22-4a0e-93bb-0efec201e9e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:37Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Creating volume 083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:37 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c7345bfb-12b5-455c-9229-81e515ccbe15 tempest-VolumeImageDependencyTests-1908425456 None] Lock "cinder-0a653d0f-c34c-4c4a-8621-112a7310a2b1-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:37 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 1073741824 Nov 05 11:14:37 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:37 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3ee4cde6-1b33-4a92-aca9-b68f02f16ebb tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-b8cb01cd-2c31-442d-94b6-0586407e13ca-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-b8cb01cd-2c31-442d-94b6-0586407e13ca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-b8cb01cd-2c31-442d-94b6-0586407e13ca" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b8cb01cd-2c31-442d-94b6-0586407e13ca" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot b8cb01cd-2c31-442d-94b6-0586407e13ca of volume b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9433660f-b5ec-48d5-bea8-a64a9a4b1460]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:37 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 1073741824" returned: 0 in 0.663s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:37 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:37 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 Nov 05 11:14:37 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:37 devstack sudo[107339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca Nov 05 11:14:37 devstack sudo[107339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:38 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4" returned: 0 in 0.375s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.097s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15f6a467-71d4-4d2f-8128-ac1026a40281) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42c6578-1424-48b6-8328-b64b839c0bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:38 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Volume volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 (083cc99d-8e22-4a0e-93bb-0efec201e9e4): created successfully Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d42c6578-1424-48b6-8328-b64b839c0bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:38 devstack sudo[107339]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (6e20be80-0f0f-4e38-9af7-ee93b4318f52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca" returned: 0 in 0.506s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b60611d1-0c0a-4edc-b55b-24f95706e66b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:38 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-7d679d46-4576-480c-b40e-d8f4c97081ee tempest-ProjectReaderTests-1253151684 None] Created volume successfully. Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642d16e-f5ff-4357-a1c8-5f09ecefae6c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:38 devstack sudo[107347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b Nov 05 11:14:38 devstack sudo[107347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:38 devstack sudo[107347]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b" returned: 0 in 0.441s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:38 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:38 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca Nov 05 11:14:38 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Creating offline snapshot 495cf315-c7eb-4bd8-9a1b-984d3954d162 of volume 083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba75ac10-a7a0-4062-b628-79a4f8f73ee3]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:39 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca" returned: 0 in 0.577s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:39 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 Nov 05 11:14:39 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:39 devstack sudo[107360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca Nov 05 11:14:39 devstack sudo[107360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:39 devstack sudo[107360]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b.b8cb01cd-2c31-442d-94b6-0586407e13ca" returned: 0 in 0.320s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:39 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4" returned: 0 in 0.515s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b8cb01cd-2c31-442d-94b6-0586407e13ca" released by "_delete_snapshot" :: held 2.022s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" released by "delete_snapshot" :: held 2.065s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:39 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 1G Nov 05 11:14:39 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Created reservations ['a8d75bd6-ea8d-4ad5-b75b-c90984e2b6b6', '5cff0b19-1367-421c-b589-54dfb3f3cd81', 'c361a5bf-b563-4dd6-b3bd-377000bfe6dd', 'c45d62cd-4c35-4ce7-a7e6-6770351787bf'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:39 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:14:39 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a2a742d5-c695-431a-9d1d-217bf0f85610 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-b8cb01cd-2c31-442d-94b6-0586407e13ca-delete_snapshot" released by "delete_snapshot" :: held 2.318s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:40 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 1G" returned: 0 in 0.577s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:40 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 Nov 05 11:14:40 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:40 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162" returned: 0 in 0.336s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:40 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 is being set with open permissions: ugo+rw Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:40 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 Nov 05 11:14:40 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-b60611d1-0c0a-4edc-b55b-24f95706e66b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-b60611d1-0c0a-4edc-b55b-24f95706e66b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:40 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162" returned: 0 in 0.306s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" acquired by "delete_volume" :: waited 0.036s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:40 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info Nov 05 11:14:40 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[25792220-c9bc-40d3-8b10-aab229b2acf6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:40 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:41 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b Nov 05 11:14:41 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:41 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:41 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info is being set with open permissions: ugo+rw Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:41 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info Nov 05 11:14:41 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:41 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b" returned: 0 in 0.527s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:41 devstack sudo[107392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b Nov 05 11:14:41 devstack sudo[107392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:41 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.info" returned: 0 in 0.334s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:41 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a62dcbde-4113-45dd-b554-b2507b3f9c0a tempest-ProjectReaderTests-1253151684 None] Create snapshot completed successfully Nov 05 11:14:41 devstack sudo[107392]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-b60611d1-0c0a-4edc-b55b-24f95706e66b" returned: 0 in 0.378s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:41 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-b60611d1-0c0a-4edc-b55b-24f95706e66b" released by "delete_volume" :: held 1.001s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Created reservations ['c71d329a-b74d-4b0b-9179-e2dc6e9abd0d', '4d521a62-1477-4b86-9255-c3adaedb302f', 'c4026afb-2a77-4437-8875-e2d39705586c', 'd67f7e83-8995-4bc6-b945-752c928cec1c'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-043f656d-bf6e-4e3a-8f39-e68669c47bec tempest-ProjectAdminTests-1454287222 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.4552612304688, 'free_capacity_gb': 1773.4552612304688, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87369) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:42 devstack sudo[107396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:42 devstack sudo[107396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-495cf315-c7eb-4bd8-9a1b-984d3954d162-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-495cf315-c7eb-4bd8-9a1b-984d3954d162-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-495cf315-c7eb-4bd8-9a1b-984d3954d162" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-495cf315-c7eb-4bd8-9a1b-984d3954d162" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Deleting offline snapshot 495cf315-c7eb-4bd8-9a1b-984d3954d162 of volume 083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] snapshot_file for this snap is: volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e83ea5ec-3f07-4743-b272-ce1a932ade92]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:42 devstack sudo[107396]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.326s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:42 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-63cd2b68-8cd1-4978-b78a-0e6a7f526093 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-b60611d1-0c0a-4edc-b55b-24f95706e66b-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:42 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 Nov 05 11:14:42 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:42 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162" returned: 0 in 0.458s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[29535a4b-2f94-4a63-bef2-35defcba20b9]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:42 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:43 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 Nov 05 11:14:43 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:43 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4" returned: 0 in 0.691s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:43 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 Nov 05 11:14:43 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (bd19fba3-f2d0-4572-a31d-c1e96f3b8270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bbe2fe-b460-49af-9fa2-1d423106502c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58bbe2fe-b460-49af-9fa2-1d423106502c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427794815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:44Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3839f4-9893-4f39-8350-bfc782b82f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3839f4-9893-4f39-8350-bfc782b82f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be28887e-5d77-41f7-9c61-9f9f81cd9e4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be28887e-5d77-41f7-9c61-9f9f81cd9e4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947', 'volume_name': 'volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd799ec0-ab6c-48e4-ba6e-62c3e90ee926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd799ec0-ab6c-48e4-ba6e-62c3e90ee926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00060e18-6152-4b9c-9ef7-1a55b6f48153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:43 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Volume cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947', 'volume_size': 1} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-427794815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:44Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Creating volume cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:43 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:43 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:43 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 1073741824 Nov 05 11:14:43 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:44 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162" returned: 0 in 0.636s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:44 devstack sudo[107420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162 Nov 05 11:14:44 devstack sudo[107420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:44 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 1073741824" returned: 0 in 0.686s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:44 devstack sudo[107420]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4.495cf315-c7eb-4bd8-9a1b-984d3954d162" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:44 devstack sudo[107424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 Nov 05 11:14:44 devstack sudo[107424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-495cf315-c7eb-4bd8-9a1b-984d3954d162" released by "_delete_snapshot" :: held 2.378s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" released by "delete_snapshot" :: held 2.422s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Created reservations ['6c668349-fa48-4851-b53a-df492d0b5b95', '12c52285-f488-403d-80d8-811bbc7c3761', '4264c26a-3fcc-4afa-b60a-e5ced05b25d1', '90296f6a-fc8e-4178-b3c0-33736bd6faed'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:44 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Delete snapshot completed successfully. Nov 05 11:14:44 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-19c3942e-6e4a-459d-9566-c3bd6c244a88 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-495cf315-c7eb-4bd8-9a1b-984d3954d162-delete_snapshot" released by "delete_snapshot" :: held 2.658s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:45 devstack sudo[107424]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (1167ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00060e18-6152-4b9c-9ef7-1a55b6f48153) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8572199f-5af5-4d61-81f1-b394c6fd55b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Volume volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 (cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947): created successfully Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8572199f-5af5-4d61-81f1-b394c6fd55b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (bd19fba3-f2d0-4572-a31d-c1e96f3b8270) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-91d0a545-5ae3-4221-8ce7-3685e6e132de tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-083cc99d-8e22-4a0e-93bb-0efec201e9e4-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-083cc99d-8e22-4a0e-93bb-0efec201e9e4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[99ce5e2d-12d7-4d2a-941f-faea55cee3b8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:45 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 Nov 05 11:14:45 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot fc4221f2-85f5-4918-a2b2-0c8b6e66f012 of volume cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dbd7c26-8057-4a40-815b-b446e7282bdd]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:46 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4" returned: 0 in 0.597s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:46 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4 Nov 05 11:14:46 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:46 devstack sudo[107433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 Nov 05 11:14:46 devstack sudo[107433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:46 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-083cc99d-8e22-4a0e-93bb-0efec201e9e4" returned: 0 in 0.356s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-083cc99d-8e22-4a0e-93bb-0efec201e9e4" released by "delete_volume" :: held 1.048s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:46 devstack sudo[107433]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" returned: 0 in 0.517s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:46 devstack sudo[107441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 1G Nov 05 11:14:46 devstack sudo[107441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Created reservations ['7077d0dd-a8dc-4947-8757-f12f1b965e70', 'e47c2c64-28fb-4ebe-9e23-add7ba6e3626', '272243f8-ad04-49b2-bfa4-3f263e1199e8', '1a6ff4fc-a793-4383-87a9-167e74b88680'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:47 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:47 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:47 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.333s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Deleted volume successfully. Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bc8a103c-d417-4851-b8a8-1f6c89c3939e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-083cc99d-8e22-4a0e-93bb-0efec201e9e4-delete_volume" released by "delete_volume" :: held 1.751s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:47 devstack sudo[107441]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 1G" returned: 0 in 0.666s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:47 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 Nov 05 11:14:47 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:47 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012" returned: 0 in 0.462s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:47 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 is being set with open permissions: ugo+rw Nov 05 11:14:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:47 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 Nov 05 11:14:47 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:48 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012" returned: 0 in 0.356s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:48 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info Nov 05 11:14:48 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (2aa89c93-4137-4eda-ab6f-76265f22f620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea774ba-b750-4b7f-9180-624110e374a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ea774ba-b750-4b7f-9180-624110e374a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833725576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea713d64-43b1-41c8-9dbd-cc0600b42a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:48Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352eb93f-f7e5-453d-abd7-891359195f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (352eb93f-f7e5-453d-abd7-891359195f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83061aa0-bfb8-4ec3-a6cf-33ae974cb195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83061aa0-bfb8-4ec3-a6cf-33ae974cb195) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea713d64-43b1-41c8-9dbd-cc0600b42a4b', 'volume_name': 'volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1057512f-d235-461f-a386-84a7d2d61137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1057512f-d235-461f-a386-84a7d2d61137) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8178f654-8de2-403c-b3bb-86c559d543c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Volume ea713d64-43b1-41c8-9dbd-cc0600b42a4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b', 'volume_size': 1} Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:48 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info" returned: 0 in 0.536s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:48 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info is being set with open permissions: ugo+rw Nov 05 11:14:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:48 devstack sudo[107464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info Nov 05 11:14:48 devstack sudo[107464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:49 devstack sudo[107464]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.info" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.368s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1833725576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea713d64-43b1-41c8-9dbd-cc0600b42a4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:48Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Creating volume ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:49 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:49 devstack sudo[107467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b 1073741824 Nov 05 11:14:49 devstack sudo[107467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4898d86b-290b-412c-a7bc-022c48693374 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Flow 'volume_create_manager' (8b4bd407-ff48-4d40-a6fc-d777778ec919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6ca273-9f39-407a-910a-13d8d89cdf3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd6ca273-9f39-407a-910a-13d8d89cdf3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765369386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e742d67-f3d3-4bbd-bbc8-902002031cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b425e4e75cad46b4a5936dd7ab9786ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:49Z,use_quota=True,user_id='9d7c260fa55646ce8adaacca841f4296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6ce07-2be5-4068-94bb-58eaae4d809d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cca6ce07-2be5-4068-94bb-58eaae4d809d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2998584-f856-4f23-bd61-45cef97cd5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2998584-f856-4f23-bd61-45cef97cd5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e742d67-f3d3-4bbd-bbc8-902002031cb8', 'volume_name': 'volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7a9d96-7fc5-4411-933e-4ae6cbdae2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d7a9d96-7fc5-4411-933e-4ae6cbdae2d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b708bf7-38df-46b8-8a88-8d3de60ca02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Volume 3e742d67-f3d3-4bbd-bbc8-902002031cb8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8', 'volume_size': 1} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:49 devstack sudo[107467]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b 1073741824" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:49 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b Nov 05 11:14:49 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-fc4221f2-85f5-4918-a2b2-0c8b6e66f012-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-fc4221f2-85f5-4918-a2b2-0c8b6e66f012-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-fc4221f2-85f5-4918-a2b2-0c8b6e66f012" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-fc4221f2-85f5-4918-a2b2-0c8b6e66f012" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot fc4221f2-85f5-4918-a2b2-0c8b6e66f012 of volume cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:49 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.453s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1765369386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e742d67-f3d3-4bbd-bbc8-902002031cb8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b425e4e75cad46b4a5936dd7ab9786ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:49Z,use_quota=True,user_id='9d7c260fa55646ce8adaacca841f4296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Creating volume 3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:49 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[6149af6b-ea51-4717-9aea-4a6b51fe458d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:49 devstack sudo[107476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 1073741824 Nov 05 11:14:49 devstack sudo[107476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8178f654-8de2-403c-b3bb-86c559d543c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b860bc-51f2-4a29-9f85-b85e9e906d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:49 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Volume volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b (ea713d64-43b1-41c8-9dbd-cc0600b42a4b): created successfully Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (24b860bc-51f2-4a29-9f85-b85e9e906d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (2aa89c93-4137-4eda-ab6f-76265f22f620) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-edeb050b-2015-4f97-bcec-08378c26c92e tempest-ProjectReaderTests-1253151684 None] Created volume successfully. Nov 05 11:14:50 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 Nov 05 11:14:50 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:50 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:50 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:50 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012" returned: 0 in 0.503s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a39fd36f-057b-4831-9903-4dd517448702]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:50 devstack sudo[107476]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 1073741824" returned: 0 in 0.603s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:50 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.323s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:50 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 Nov 05 11:14:50 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:14:50 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:14:50 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:50 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.325s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:50 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b708bf7-38df-46b8-8a88-8d3de60ca02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbae197-49fa-4742-b018-34429519dd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" returned: 0 in 0.481s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Volume volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 (3e742d67-f3d3-4bbd-bbc8-902002031cb8): created successfully Nov 05 11:14:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bbae197-49fa-4742-b018-34429519dd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Flow 'volume_create_manager' (8b4bd407-ff48-4d40-a6fc-d777778ec919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:51 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 Nov 05 11:14:51 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-86bbc3fe-8fbc-47d6-8023-f858432fef11 tempest-SnapshotDependencyTests-189504770 None] Created volume successfully. Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Creating offline snapshot 8054fd9e-5608-4aad-a113-5e0a7e65d44e of volume ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bf8c5d-60e8-4c14-8c2e-0582f3989ea5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:51 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012" returned: 0 in 0.478s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:51 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012 Nov 05 11:14:51 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:51 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b Nov 05 11:14:51 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:51 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947.fc4221f2-85f5-4918-a2b2-0c8b6e66f012" returned: 0 in 0.302s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-fc4221f2-85f5-4918-a2b2-0c8b6e66f012" released by "_delete_snapshot" :: held 1.906s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" released by "delete_snapshot" :: held 1.936s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:51 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:51 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e 1G Nov 05 11:14:51 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Created reservations ['46b85467-94f7-41b4-8b14-43e4bb339c94', '62067d0f-f586-4eee-94a3-96bbe554c227', '1c4bff1e-4c7a-4100-ad2d-acc9e4bff49d', 'a1782147-ef7c-4aaf-8959-7a93a7052bdd'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:51 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:14:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-50ff3867-2195-4c2d-b20f-173f571d52f7 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-fc4221f2-85f5-4918-a2b2-0c8b6e66f012-delete_snapshot" released by "delete_snapshot" :: held 2.133s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" acquired by "delete_volume" :: waited 0.024s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[40058bc4-8226-4e22-b196-149bdb7144a2]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:52 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 Nov 05 11:14:52 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:52 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e 1G" returned: 0 in 0.561s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:52 devstack sudo[107520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e Nov 05 11:14:52 devstack sudo[107520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:52 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:52 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947 Nov 05 11:14:52 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:52 devstack sudo[107520]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e" returned: 0 in 0.350s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:52 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e is being set with open permissions: ugo+rw Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:52 devstack sudo[107530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e Nov 05 11:14:52 devstack sudo[107530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:52 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947" released by "delete_volume" :: held 0.806s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Created reservations ['fa9603b2-8ea2-4486-a797-d49c3b106c52', '760324cc-617d-4ed4-a2b5-6ba18487307b', '27e836d8-4ecc-45c3-81dc-6578e08ac8f1', '09878712-8e6c-4462-aa6d-072d69d38f5f'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:53 devstack sudo[107530]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e" returned: 0 in 0.330s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:53 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:53 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:53 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:53 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:53 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info" returned: 0 in 0.309s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:53 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info is being set with open permissions: ugo+rw Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:53 devstack sudo[107539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info Nov 05 11:14:53 devstack sudo[107539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:53 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.347s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-bbf47eab-f5b9-4b79-92dc-3a84b54d19b3 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-cd3fd4f4-0fe7-4b1d-b5e9-ce95c63c7947-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:53 devstack sudo[107539]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.info" returned: 0 in 0.337s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.989s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Creating offline snapshot 2d692a21-e7a0-4022-8128-3ad696be9a7b of volume 3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:14:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-6f8e8c5f-756b-4b8f-8619-4b3b7b0e2198 tempest-ProjectReaderTests-1253151684 None] Create snapshot completed successfully Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2840d527-6a87-4937-a99b-33eb96307879]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (ecbb62c0-b336-4446-be19-c874337277ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6c3b17-f1ac-436e-bf61-bdd3711e1a1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d6c3b17-f1ac-436e-bf61-bdd3711e1a1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945417636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a47ce70-be0f-4316-ae84-24979c202eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:54Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61ddd9-eae0-434d-8a61-207c0bf6e287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f61ddd9-eae0-434d-8a61-207c0bf6e287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6c9ca6-8816-4757-bb9f-1db7e782b590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d6c9ca6-8816-4757-bb9f-1db7e782b590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a47ce70-be0f-4316-ae84-24979c202eed', 'volume_name': 'volume-5a47ce70-be0f-4316-ae84-24979c202eed', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78cb818-da9b-4e48-a55b-ea0634879247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b78cb818-da9b-4e48-a55b-ea0634879247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a18a05-3a34-4a22-8c3b-6f38503fcded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:54 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Volume 5a47ce70-be0f-4316-ae84-24979c202eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a47ce70-be0f-4316-ae84-24979c202eed', 'volume_size': 1} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:54 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:14:54 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:54 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.418s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:54 devstack sudo[107548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b 1G Nov 05 11:14:54 devstack sudo[107548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-8054fd9e-5608-4aad-a113-5e0a7e65d44e-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-8054fd9e-5608-4aad-a113-5e0a7e65d44e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-8054fd9e-5608-4aad-a113-5e0a7e65d44e" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-8054fd9e-5608-4aad-a113-5e0a7e65d44e" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Deleting offline snapshot 8054fd9e-5608-4aad-a113-5e0a7e65d44e of volume ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] snapshot_file for this snap is: volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[17a0cc8d-6794-4897-a3fd-a791828fd7e1]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:54 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e Nov 05 11:14:54 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:54 devstack sudo[107548]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b 1G" returned: 0 in 0.540s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:54 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:14:54 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:55 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[37f92291-e309-4485-9273-446361f2df48]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:55 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:55 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b is being set with open permissions: ugo+rw Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:55 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:14:55 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:55 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b Nov 05 11:14:55 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:55 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.279s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:55 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info Nov 05 11:14:55 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:55 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" returned: 0 in 0.496s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:55 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e Nov 05 11:14:55 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:55 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:55 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info is being set with open permissions: ugo+rw Nov 05 11:14:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:55 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info Nov 05 11:14:55 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:56 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e" returned: 0 in 0.457s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:56 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.info" returned: 0 in 0.315s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:56 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e Nov 05 11:14:56 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.385s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.161s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-945417636',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a47ce70-be0f-4316-ae84-24979c202eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:54Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Creating volume 5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:56 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:56 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed 1073741824 Nov 05 11:14:56 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-566e72fa-2449-474c-b9a6-86b9045976b2 tempest-SnapshotDependencyTests-189504770 None] Create snapshot completed successfully Nov 05 11:14:56 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b.8054fd9e-5608-4aad-a113-5e0a7e65d44e" returned: 0 in 0.277s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-8054fd9e-5608-4aad-a113-5e0a7e65d44e" released by "_delete_snapshot" :: held 1.838s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" released by "delete_snapshot" :: held 1.873s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Created reservations ['8c73ff77-c7a7-463e-87c5-b0197da0eb60', '97a3e251-ad98-4fa7-9eee-2d37dea6d37c', '365b9367-f729-44f1-8cf4-a2288a5ef4c6', 'be505ac2-f79c-4664-a168-fd8e7403164b'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Delete snapshot completed successfully. Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f4d16266-2767-41fb-9294-83e7ad95dfb2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-8054fd9e-5608-4aad-a113-5e0a7e65d44e-delete_snapshot" released by "delete_snapshot" :: held 2.046s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-ea713d64-43b1-41c8-9dbd-cc0600b42a4b-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "cinder-ea713d64-43b1-41c8-9dbd-cc0600b42a4b-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:56 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed 1073741824" returned: 0 in 0.601s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d71e7a8a-d3e8-4931-a383-19ece30dd114]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:56 devstack sudo[107595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed Nov 05 11:14:56 devstack sudo[107595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:57 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b Nov 05 11:14:57 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:57 devstack sudo[107595]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed" returned: 0 in 0.319s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a18a05-3a34-4a22-8c3b-6f38503fcded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a47ce70-be0f-4316-ae84-24979c202eed', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aba2e2-a34a-4240-9cd2-dfa4f5719a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Volume volume-5a47ce70-be0f-4316-ae84-24979c202eed (5a47ce70-be0f-4316-ae84-24979c202eed): created successfully Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76aba2e2-a34a-4240-9cd2-dfa4f5719a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (ecbb62c0-b336-4446-be19-c874337277ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-4c20474b-e8de-487f-bb92-eec1c99b06f0 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:14:57 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" returned: 0 in 0.486s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:57 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b Nov 05 11:14:57 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:57 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-ea713d64-43b1-41c8-9dbd-cc0600b42a4b" released by "delete_volume" :: held 0.869s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Flow 'volume_create_manager' (2bc8f49e-b911-432b-bdb3-94b50cb77271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc48fec-2f10-4a59-b7f1-c3d41bbb16eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Created reservations ['51e2876a-f400-4ae5-b571-09e40ce78107', 'e2375788-beaf-45ec-a0ba-b12e73708f1c', '831c2682-b81d-4cf7-a09a-2701c1984b97', '19115af9-6300-49ba-8454-4f553bdb7037'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc48fec-2f10-4a59-b7f1-c3d41bbb16eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5dcec020-c191-4df9-967f-e8b081630145,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b425e4e75cad46b4a5936dd7ab9786ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2d692a21-e7a0-4022-8128-3ad696be9a7b,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:14:58Z,use_quota=True,user_id='9d7c260fa55646ce8adaacca841f4296',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a61297a-96e1-4b56-aadf-d51054959f7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a61297a-96e1-4b56-aadf-d51054959f7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cffe0f77-72cc-4967-bcb6-fa9609ae7efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cffe0f77-72cc-4967-bcb6-fa9609ae7efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5dcec020-c191-4df9-967f-e8b081630145', 'volume_name': 'volume-5dcec020-c191-4df9-967f-e8b081630145', 'volume_size': 1, 'snapshot_id': '2d692a21-e7a0-4022-8128-3ad696be9a7b'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a4df4-3417-4c71-ad73-fede549b9b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c39a4df4-3417-4c71-ad73-fede549b9b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5de2d4e-2286-45d1-a0f7-c7abba8f3060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:57 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Volume 5dcec020-c191-4df9-967f-e8b081630145: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5dcec020-c191-4df9-967f-e8b081630145', 'volume_size': 1, 'snapshot_id': '2d692a21-e7a0-4022-8128-3ad696be9a7b'} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b-5dcec020-c191-4df9-967f-e8b081630145" by "_create_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b-5dcec020-c191-4df9-967f-e8b081630145" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Creating volume 5dcec020-c191-4df9-967f-e8b081630145 from snapshot 2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" by "_copy_volume_from_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] snapshot: 2d692a21-e7a0-4022-8128-3ad696be9a7b, volume: 5dcec020-c191-4df9-967f-e8b081630145, {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:14:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a012f37-6d01-4eaf-8a9f-b1ab9de42eb6]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:58 devstack sudo[107606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:14:58 devstack sudo[107606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:58 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:14:58 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:14:58 devstack sudo[107606]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.394s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:14:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Deleted volume successfully. Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-06857414-d54a-4cab-8f84-2614ad5bb74c tempest-ProjectReaderTests-1253151684 None] Lock "cinder-ea713d64-43b1-41c8-9dbd-cc0600b42a4b-delete_volume" released by "delete_volume" :: held 1.692s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:14:58 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.483s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7e5f8fa-27a7-4ef6-9887-ee4bf2e81b9f]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:58 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:14:58 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:58 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.402s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] will copy from snapshot at /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Creating direct copy from snapshot {{(pid=87369) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG cinder.utils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Path /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 not found in is_blk_device check {{(pid=87369) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 05 11:14:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:14:58 devstack sudo[107620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 Nov 05 11:14:58 devstack sudo[107620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (e002c71c-cd2c-4d2c-9f49-369ac16a2154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955f7ee4-9736-4c57-b2c0-f4e094d640d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (955f7ee4-9736-4c57-b2c0-f4e094d640d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995090489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acf7a55-e5e8-478c-a167-01ac2aa3646e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:00Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899cb9ea-399d-478e-99a2-eb137fbe9bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899cb9ea-399d-478e-99a2-eb137fbe9bd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eaec5d-ced5-43ca-9f31-dee37342535d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (37eaec5d-ced5-43ca-9f31-dee37342535d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5acf7a55-e5e8-478c-a167-01ac2aa3646e', 'volume_name': 'volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e997fb2e-098f-4983-bf4c-5e4c7795c187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e997fb2e-098f-4983-bf4c-5e4c7795c187) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f21da-80d2-42a4-88b3-c52ef30f228e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:14:59 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Volume 5acf7a55-e5e8-478c-a167-01ac2aa3646e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e', 'volume_size': 1} Nov 05 11:14:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:06 devstack sudo[107620]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145" returned: 0 in 7.555s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.image.image_utils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Image conversion details: src /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8, size 1024.00 MB, duration 7.56 sec, destination /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 {{(pid=87369) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 05 11:15:06 devstack cinder-volume[87369]: INFO cinder.image.image_utils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Converted 1024.00 MB image at 135.51 MB/s Nov 05 11:15:06 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 is being set with open permissions: ugo+rw Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:06 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 Nov 05 11:15:06 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:06 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145" returned: 0 in 0.267s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" released by "_copy_volume_from_snapshot" :: held 8.851s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b-5dcec020-c191-4df9-967f-e8b081630145" released by "_create_volume_from_snapshot" :: held 8.926s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.949s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.481s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot 4ac5fe22-acd6-4140-98ba-0925f7ad270a of volume 5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5de2d4e-2286-45d1-a0f7-c7abba8f3060) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5dcec020-c191-4df9-967f-e8b081630145', 'volume_size': 1, 'snapshot_id': '2d692a21-e7a0-4022-8128-3ad696be9a7b'}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be994abc-2d77-4d99-8ae9-1fa5ecbfe064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[49eb111d-ef58-428f-92ba-87e7865ecaea]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:06 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Volume volume-5dcec020-c191-4df9-967f-e8b081630145 (5dcec020-c191-4df9-967f-e8b081630145): created successfully Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be994abc-2d77-4d99-8ae9-1fa5ecbfe064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:06 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Flow 'volume_create_manager' (2bc8f49e-b911-432b-bdb3-94b50cb77271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:06 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-cefb5162-48a5-4b82-8446-08cdffaf62fa tempest-SnapshotDependencyTests-189504770 None] Created volume successfully. Nov 05 11:15:06 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed Nov 05 11:15:06 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:07 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed" returned: 0 in 0.411s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:07 devstack sudo[107652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a 1G Nov 05 11:15:07 devstack sudo[107652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:07 devstack sudo[107652]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a 1G" returned: 0 in 0.485s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a47ce70-be0f-4316-ae84-24979c202eed -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:07 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a47ce70-be0f-4316-ae84-24979c202eed -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a Nov 05 11:15:07 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-2d692a21-e7a0-4022-8128-3ad696be9a7b-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-2d692a21-e7a0-4022-8128-3ad696be9a7b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Deleting offline snapshot 2d692a21-e7a0-4022-8128-3ad696be9a7b of volume 3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] snapshot_file for this snap is: volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[991ed830-3c22-4201-b9ed-4f29ee61b705]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:07 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:08 devstack sudo[107660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:15:08 devstack sudo[107660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:08 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5a47ce70-be0f-4316-ae84-24979c202eed -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a" returned: 0 in 0.416s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:08 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a is being set with open permissions: ugo+rw Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:08 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a Nov 05 11:15:08 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:08 devstack sudo[107660]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.490s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac5f681-f172-4934-bbb9-94468ecff77b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:08 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:08 devstack sudo[107673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info Nov 05 11:15:08 devstack sudo[107673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:08 devstack sudo[107672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:15:08 devstack sudo[107672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:08 devstack sudo[107673]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info" returned: 0 in 0.247s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:08 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info is being set with open permissions: ugo+rw Nov 05 11:15:08 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:08 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info Nov 05 11:15:08 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:09 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.info" returned: 0 in 0.241s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.211s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:09 devstack sudo[107672]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.229s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:14:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1995090489',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5acf7a55-e5e8-478c-a167-01ac2aa3646e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:14:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:00Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Creating volume 5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:09 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.591s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:09 devstack sudo[107683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e 1073741824 Nov 05 11:15:09 devstack sudo[107683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:09 devstack sudo[107684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:15:09 devstack sudo[107684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-03383636-91de-4120-8b26-41ff3706dd80 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:15:09 devstack sudo[107684]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.372s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:09 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b Nov 05 11:15:09 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:09 devstack sudo[107683]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e 1073741824" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:09 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e Nov 05 11:15:09 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:09 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8.2d692a21-e7a0-4022-8128-3ad696be9a7b" returned: 0 in 0.268s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-2d692a21-e7a0-4022-8128-3ad696be9a7b" released by "_delete_snapshot" :: held 1.845s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" released by "delete_snapshot" :: held 1.884s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:09 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (123f21da-80d2-42a4-88b3-c52ef30f228e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92490c49-b72e-43c1-8a2b-8eda5dd8b595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:09 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Volume volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e (5acf7a55-e5e8-478c-a167-01ac2aa3646e): created successfully Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92490c49-b72e-43c1-8a2b-8eda5dd8b595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (e002c71c-cd2c-4d2c-9f49-369ac16a2154) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Created reservations ['d3e3fe9b-6863-4824-a58c-515e6f900e0e', '7fe09a7a-d4d1-4554-afb2-78747e3503bc', '8f13e20f-e387-4be3-bef0-554f0e1176e8', '8d420630-b220-4cef-9fe6-00f3bb0121fe'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-063c9ce4-2c77-4710-9130-287e3ac4b674 tempest-ProjectReaderTests-1253151684 None] Created volume successfully. Nov 05 11:15:09 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Delete snapshot completed successfully. Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c4b006dd-6a59-422a-aec8-f90f083ca8a0 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-2d692a21-e7a0-4022-8128-3ad696be9a7b-delete_snapshot" released by "delete_snapshot" :: held 2.089s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-4ac5fe22-acd6-4140-98ba-0925f7ad270a-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-4ac5fe22-acd6-4140-98ba-0925f7ad270a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-4ac5fe22-acd6-4140-98ba-0925f7ad270a" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4ac5fe22-acd6-4140-98ba-0925f7ad270a" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:09 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot 4ac5fe22-acd6-4140-98ba-0925f7ad270a of volume 5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-3e742d67-f3d3-4bbd-bbc8-902002031cb8-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d28f292-2730-4eb2-8beb-cf11ea604310]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-3e742d67-f3d3-4bbd-bbc8-902002031cb8-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:10 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a Nov 05 11:15:10 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[192da6f7-34bb-4025-9f85-aaf88881b516]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:15:10 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:10 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a" returned: 0 in 0.437s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5a47ce70-be0f-4316-ae84-24979c202eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[119660b9-5ab4-4767-8c55-27328e8c55bb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8 Nov 05 11:15:10 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:10 devstack sudo[107710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed Nov 05 11:15:10 devstack sudo[107710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Creating offline snapshot 9c31d8bf-e9eb-4247-9fde-47e93c3dd970 of volume 5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3630be48-0308-46a4-8e7f-59aed41af662]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack sudo[107715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e Nov 05 11:15:10 devstack sudo[107715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:10 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-3e742d67-f3d3-4bbd-bbc8-902002031cb8" returned: 0 in 0.287s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-3e742d67-f3d3-4bbd-bbc8-902002031cb8" released by "delete_volume" :: held 0.748s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:10 devstack sudo[107710]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed" returned: 0 in 0.428s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:10 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Created reservations ['6680b269-0cf0-43db-8c5d-e8552e9fe316', '51dc4ccd-4e5a-4347-8c0f-62118aa33726', '2633bce8-a0e3-4ca1-8d0d-57aba6b6a77b', 'c0c387d5-2888-432e-aad4-5ee92f81c1be'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:10 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a Nov 05 11:15:10 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:11 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack sudo[107715]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e" returned: 0 in 0.431s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 1G Nov 05 11:15:11 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-5dcec020-c191-4df9-967f-e8b081630145-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-5dcec020-c191-4df9-967f-e8b081630145-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fe5a71d-eff3-4346-b81a-3fd993ad87ca]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.303s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Deleted volume successfully. Nov 05 11:15:11 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a" returned: 0 in 0.460s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-d7ef9103-5277-427b-8ca3-f869249bdea3 tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-3e742d67-f3d3-4bbd-bbc8-902002031cb8-delete_volume" released by "delete_volume" :: held 1.367s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:11 devstack sudo[107735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a Nov 05 11:15:11 devstack sudo[107735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack sudo[107734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 Nov 05 11:15:11 devstack sudo[107734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 1G" returned: 0 in 0.535s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 Nov 05 11:15:11 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack sudo[107735]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed.4ac5fe22-acd6-4140-98ba-0925f7ad270a" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-4ac5fe22-acd6-4140-98ba-0925f7ad270a" released by "_delete_snapshot" :: held 1.750s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" released by "delete_snapshot" :: held 1.775s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:11 devstack sudo[107734]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Created reservations ['946e15d7-6102-4970-a9c6-6b9f39f85603', 'd7616069-22f5-4696-a728-ac4f4d9dc056', '297b1efa-60ec-474d-aba8-03ddd3d37290', 'f656bac3-972a-4bec-bf17-09f7e49de738'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145" returned: 0 in 0.454s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145 Nov 05 11:15:11 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:11 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-eb11d663-9187-4fff-bafb-7cfb7e968c05 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-4ac5fe22-acd6-4140-98ba-0925f7ad270a-delete_snapshot" released by "delete_snapshot" :: held 1.951s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:11 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970" returned: 0 in 0.313s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:11 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 is being set with open permissions: ugo+rw Nov 05 11:15:11 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:11 devstack sudo[107753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 Nov 05 11:15:11 devstack sudo[107753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5dcec020-c191-4df9-967f-e8b081630145" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-quobyte-5dcec020-c191-4df9-967f-e8b081630145" released by "delete_volume" :: held 0.778s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-5a47ce70-be0f-4316-ae84-24979c202eed-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-5a47ce70-be0f-4316-ae84-24979c202eed-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Created reservations ['f0e99858-1677-4a9c-906e-7a5def5ab6c2', '5c765343-8532-484c-9cdc-b33406b5ef82', '0d93f997-a1c4-447a-a1de-f6315a104fb8', '2d7ed8b1-6d47-4b52-82c2-22cfd714b817'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:12 devstack sudo[107753]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970" returned: 0 in 0.273s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c70b918-b17d-46ab-9d24-b1c74dc2a73d]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:12 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info Nov 05 11:15:12 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:12 devstack sudo[107760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:12 devstack sudo[107760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack sudo[107757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed Nov 05 11:15:12 devstack sudo[107757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info" returned: 0 in 0.300s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info is being set with open permissions: ugo+rw Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:12 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info Nov 05 11:15:12 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack sudo[107760]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.298s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Deleted volume successfully. Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-156af7dd-31b1-4352-bfba-2267b2036e3c tempest-SnapshotDependencyTests-189504770 None] Lock "cinder-5dcec020-c191-4df9-967f-e8b081630145-delete_volume" released by "delete_volume" :: held 1.422s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:12 devstack sudo[107757]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed" returned: 0 in 0.446s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:12 devstack sudo[107770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed Nov 05 11:15:12 devstack sudo[107770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:12 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.info" returned: 0 in 0.310s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:12 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.294s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:12 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-0c8b73d2-a8ce-4bce-9c57-bb7b34fdef25 tempest-ProjectReaderTests-1253151684 None] Create snapshot completed successfully Nov 05 11:15:13 devstack sudo[107770]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5a47ce70-be0f-4316-ae84-24979c202eed" returned: 0 in 0.273s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-5a47ce70-be0f-4316-ae84-24979c202eed" released by "delete_volume" :: held 0.787s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Created reservations ['0fa3201b-88b9-49ae-a671-b9ebb524fc28', 'd92be5b4-28a8-4c85-aa23-139ab4ed30a0', '77c0e2f2-13c2-4b74-9ef9-eb1503d722b0', '6aef68c8-8df8-4f49-b1e3-2b6f25b7a57e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:13 devstack sudo[107774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:13 devstack sudo[107774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:13 devstack sudo[107774]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:13 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-96507d21-af43-4775-982e-28bffae59c36 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-5a47ce70-be0f-4316-ae84-24979c202eed-delete_volume" released by "delete_volume" :: held 1.319s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-9c31d8bf-e9eb-4247-9fde-47e93c3dd970-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-9c31d8bf-e9eb-4247-9fde-47e93c3dd970-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (caf43d06-4c5e-4b45-bb0e-0891e9f59842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623aeb1e-fe50-4695-abb2-bab1f06dcfbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-9c31d8bf-e9eb-4247-9fde-47e93c3dd970" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (623aeb1e-fe50-4695-abb2-bab1f06dcfbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261109249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c982f9f-538e-409d-af4c-5afd6f089bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:14Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c2e49f-0a2f-4192-b441-03edc0beee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20c2e49f-0a2f-4192-b441-03edc0beee8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10dbdc-b9aa-47cb-89c7-283f77fadd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a10dbdc-b9aa-47cb-89c7-283f77fadd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c982f9f-538e-409d-af4c-5afd6f089bfb', 'volume_name': 'volume-1c982f9f-538e-409d-af4c-5afd6f089bfb', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741ab648-8af5-4a9e-a2b4-16a7cb5eef10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (741ab648-8af5-4a9e-a2b4-16a7cb5eef10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224a1f0-27da-4f0b-8eef-abd3bb81bed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:13 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Volume 1c982f9f-538e-409d-af4c-5afd6f089bfb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c982f9f-538e-409d-af4c-5afd6f089bfb', 'volume_size': 1} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261109249',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c982f9f-538e-409d-af4c-5afd6f089bfb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:14Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Creating volume 1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:13 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:13 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-9c31d8bf-e9eb-4247-9fde-47e93c3dd970" acquired by "_delete_snapshot" :: waited 0.084s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Deleting offline snapshot 9c31d8bf-e9eb-4247-9fde-47e93c3dd970 of volume 5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:14 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb 1073741824 Nov 05 11:15:14 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] snapshot_file for this snap is: volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81221d5-0d9e-48a2-b6eb-8db5407a0fdd]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:14 devstack sudo[107779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 Nov 05 11:15:14 devstack sudo[107779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:14 devstack sudo[107779]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970" returned: 0 in 0.435s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9dfab1-3001-459b-b6c7-4409172e2cea]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:14 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb 1073741824" returned: 0 in 0.574s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:14 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb Nov 05 11:15:14 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:14 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e Nov 05 11:15:14 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:14 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb" returned: 0 in 0.304s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224a1f0-27da-4f0b-8eef-abd3bb81bed7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c982f9f-538e-409d-af4c-5afd6f089bfb', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51272f7-fb7c-4842-b95c-8de8445b5b6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=216,cinder:SELECT=173,cinder:DELETE=14,cinder:INSERT=62 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:15:14 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Volume volume-1c982f9f-538e-409d-af4c-5afd6f089bfb (1c982f9f-538e-409d-af4c-5afd6f089bfb): created successfully Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f51272f7-fb7c-4842-b95c-8de8445b5b6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:14 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (caf43d06-4c5e-4b45-bb0e-0891e9f59842) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e" returned: 0 in 0.439s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:14 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2dd60820-440e-47c4-8646-5edf61c16fd9 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:15:15 devstack sudo[107799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 Nov 05 11:15:15 devstack sudo[107799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=214,cinder:SELECT=162,cinder:INSERT=60,cinder:DELETE=22 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:15:15 devstack sudo[107799]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970" returned: 0 in 0.391s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:15 devstack sudo[107804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970 Nov 05 11:15:15 devstack sudo[107804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:15 devstack sudo[107804]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e.9c31d8bf-e9eb-4247-9fde-47e93c3dd970" returned: 0 in 0.301s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-9c31d8bf-e9eb-4247-9fde-47e93c3dd970" released by "_delete_snapshot" :: held 1.690s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" released by "delete_snapshot" :: held 1.783s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Created reservations ['a5555808-9320-4a50-950a-04c73cc3364f', '597eab47-48ff-4fc2-93db-4280586fbc4f', '091ba515-5f76-470e-88ff-ea483b8c4af0', 'c65f2123-52da-4ef7-be70-f97dc40f8057'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:15 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Delete snapshot completed successfully. Nov 05 11:15:15 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c8c00651-b545-438e-8d8e-8642448fffc2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-9c31d8bf-e9eb-4247-9fde-47e93c3dd970-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-5acf7a55-e5e8-478c-a167-01ac2aa3646e-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-5acf7a55-e5e8-478c-a167-01ac2aa3646e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d1b65e-f7ed-4202-91dc-9dac6a7b9d81]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot 76b599d1-d87a-49f6-b9cc-65407d1c7465 of volume 1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c0da1d-23b1-4a83-8a78-b747d1d25477]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:16 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e Nov 05 11:15:16 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:16 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb Nov 05 11:15:16 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:16 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e" returned: 0 in 0.462s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:16 devstack sudo[107814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e Nov 05 11:15:16 devstack sudo[107814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:16 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb" returned: 0 in 0.480s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:16 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 1G Nov 05 11:15:16 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:16 devstack sudo[107814]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:16 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-5acf7a55-e5e8-478c-a167-01ac2aa3646e" returned: 0 in 0.328s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-5acf7a55-e5e8-478c-a167-01ac2aa3646e" released by "delete_volume" :: held 0.918s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Created reservations ['c733c956-fe55-4d21-995f-3ac2659b0c37', '46cc4185-a3ab-4996-988a-6229b97f23cb', '528f6fbb-cc7c-4959-93ce-0274bf5564c0', '7592b763-071c-479c-b429-2742bca4c105'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:17 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:17 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:17 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 1G" returned: 0 in 0.560s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c982f9f-538e-409d-af4c-5afd6f089bfb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:17 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c982f9f-538e-409d-af4c-5afd6f089bfb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 Nov 05 11:15:17 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:17 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.376s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:17 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Deleted volume successfully. Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-5eef690c-53e9-4679-89af-8d197a58c68e tempest-ProjectReaderTests-1253151684 None] Lock "cinder-5acf7a55-e5e8-478c-a167-01ac2aa3646e-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:17 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1c982f9f-538e-409d-af4c-5afd6f089bfb -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465" returned: 0 in 0.490s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:17 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 is being set with open permissions: ugo+rw Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:17 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 Nov 05 11:15:17 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (8d011498-28f1-493d-aa9c-eac3d90a1fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:17 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867af5f7-db10-4d87-ab0c-d40ca7eab118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (867af5f7-db10-4d87-ab0c-d40ca7eab118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799425600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edb14b0-316e-42d0-ba9a-e5b37231fed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:18Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a483228-89bd-4891-96d4-f7d1d1eb1492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a483228-89bd-4891-96d4-f7d1d1eb1492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6de8d2-74a6-4ec7-9590-4f39ccb893b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (de6de8d2-74a6-4ec7-9590-4f39ccb893b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7edb14b0-316e-42d0-ba9a-e5b37231fed2', 'volume_name': 'volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339c5c2d-a597-4269-a32f-27e8ab52ec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (339c5c2d-a597-4269-a32f-27e8ab52ec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3c7955-def8-4241-a0cb-761314cf9bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:18 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Volume 7edb14b0-316e-42d0-ba9a-e5b37231fed2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2', 'volume_size': 1} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:18 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465" returned: 0 in 0.373s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:18 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info Nov 05 11:15:18 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:18 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info" returned: 0 in 0.295s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:18 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info is being set with open permissions: ugo+rw Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:18 devstack sudo[107842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info Nov 05 11:15:18 devstack sudo[107842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:18 devstack sudo[107842]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.info" returned: 0 in 0.276s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.569s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.786s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-799425600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7edb14b0-316e-42d0-ba9a-e5b37231fed2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5bcd8cd741744d8b3c6ce640e50fd9b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:18Z,use_quota=True,user_id='f2c4fecb522e42839fe1e1d9361516bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Creating volume 7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:18 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:18 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:18 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 1073741824 Nov 05 11:15:18 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:18 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ba84c67c-1306-488d-9b24-c3f7fd5b2f17 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:15:19 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 1073741824" returned: 0 in 0.494s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:19 devstack sudo[107850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 Nov 05 11:15:19 devstack sudo[107850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-76b599d1-d87a-49f6-b9cc-65407d1c7465-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-76b599d1-d87a-49f6-b9cc-65407d1c7465-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-76b599d1-d87a-49f6-b9cc-65407d1c7465" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-76b599d1-d87a-49f6-b9cc-65407d1c7465" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot 76b599d1-d87a-49f6-b9cc-65407d1c7465 of volume 1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[75d06d9a-f1a0-41f6-bdea-1778cde5ac0b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:19 devstack sudo[107850]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2" returned: 0 in 0.324s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.879s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:19 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 Nov 05 11:15:19 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a3c7955-def8-4241-a0cb-761314cf9bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22dd7e-4bcb-4fd7-92fd-8f28486af407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:19 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Volume volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 (7edb14b0-316e-42d0-ba9a-e5b37231fed2): created successfully Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a22dd7e-4bcb-4fd7-92fd-8f28486af407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:19 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Flow 'volume_create_manager' (8d011498-28f1-493d-aa9c-eac3d90a1fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:19 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-66846272-a2f4-40eb-9561-bca676988e85 tempest-ProjectReaderTests-1253151684 None] Created volume successfully. Nov 05 11:15:20 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465" returned: 0 in 0.418s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1c982f9f-538e-409d-af4c-5afd6f089bfb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[30eb3fe8-7805-4413-b278-1c807c6d592a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:20 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb Nov 05 11:15:20 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Creating offline snapshot 0c30a582-5e51-4fa4-adba-bdc9cc0499b4 of volume 7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[9931c646-a5f5-482e-90ac-deacc9cbf7a5]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:20 devstack sudo[107861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 Nov 05 11:15:20 devstack sudo[107861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:20 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb" returned: 0 in 0.492s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:20 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 Nov 05 11:15:20 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:20 devstack sudo[107861]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2" returned: 0 in 0.438s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:20 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 1G Nov 05 11:15:20 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:20 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:20 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:21 devstack sudo[107879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465 Nov 05 11:15:21 devstack sudo[107879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:21 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 1G" returned: 0 in 0.484s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:21 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 Nov 05 11:15:21 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:21 devstack sudo[107879]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb.76b599d1-d87a-49f6-b9cc-65407d1c7465" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-76b599d1-d87a-49f6-b9cc-65407d1c7465" released by "_delete_snapshot" :: held 1.782s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" released by "delete_snapshot" :: held 1.806s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Created reservations ['66dfb92b-53ef-41dc-88ed-145a427cf785', '7d1d4472-2853-4941-a11e-db0989b38b13', '09e64f50-72f9-4b5e-89cf-6c0be0e157f7', '0beeadd4-4ea9-4cb3-9605-8fa6ae8fc61e'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:21 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-a354c541-f436-4852-8c98-ee2c6fb9d2b9 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-76b599d1-d87a-49f6-b9cc-65407d1c7465-delete_snapshot" released by "delete_snapshot" :: held 1.960s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:21 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4" returned: 0 in 0.311s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:21 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 is being set with open permissions: ugo+rw Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:21 devstack sudo[107888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 Nov 05 11:15:21 devstack sudo[107888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-1c982f9f-538e-409d-af4c-5afd6f089bfb-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "cinder-1c982f9f-538e-409d-af4c-5afd6f089bfb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" acquired by "delete_volume" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:21 devstack sudo[107888]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2af28eaa-21f4-4281-8939-e86d88844cdb]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:21 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:21 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info Nov 05 11:15:21 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:21 devstack sudo[107891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb Nov 05 11:15:21 devstack sudo[107891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:22 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info" returned: 0 in 0.326s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:22 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info is being set with open permissions: ugo+rw Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:22 devstack sudo[107896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info Nov 05 11:15:22 devstack sudo[107896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:22 devstack sudo[107891]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb" returned: 0 in 0.497s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:22 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb Nov 05 11:15:22 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:22 devstack sudo[107896]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.info" returned: 0 in 0.284s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:22 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1e5d04ba-6c01-4e62-82b4-71ee6f749be4 tempest-ProjectReaderTests-1253151684 None] Create snapshot completed successfully Nov 05 11:15:22 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-1c982f9f-538e-409d-af4c-5afd6f089bfb" returned: 0 in 0.253s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-1c982f9f-538e-409d-af4c-5afd6f089bfb" released by "delete_volume" :: held 0.852s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Created reservations ['e0e5479f-9eb1-4f8b-b9cd-71fab3ae73e8', '44b9be91-0f03-4847-bf35-59ee2ef7f0ac', 'bc6d06f8-4d89-43e6-a3c6-f709e770f3ca', 'ead92dce-5aa9-4b23-a30a-de433d76c368'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:22 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:22 devstack sudo[107905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:22 devstack sudo[107905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:23 devstack sudo[107905]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.361s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:23 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-97c59025-36af-4776-a5ce-5925a39ee2fc tempest-ProjectMemberTests-1322633992 None] Lock "cinder-1c982f9f-538e-409d-af4c-5afd6f089bfb-delete_volume" released by "delete_volume" :: held 1.460s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (fda8be05-3558-4141-8ed6-aa040737d30b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ade2de-01d4-4213-8203-57aebe70b97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ade2de-01d4-4213-8203-57aebe70b97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818057715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a88af5b-3b8c-4cde-901c-49d428d84eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:23Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cace744-4e5f-4343-b944-e78e42031cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cace744-4e5f-4343-b944-e78e42031cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fb79fd-7c73-43c2-8c5e-54320d366614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34fb79fd-7c73-43c2-8c5e-54320d366614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a88af5b-3b8c-4cde-901c-49d428d84eff', 'volume_name': 'volume-8a88af5b-3b8c-4cde-901c-49d428d84eff', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0734139c-f016-42cc-862a-6f70669b417a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0734139c-f016-42cc-862a-6f70669b417a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f43937-3659-459f-8459-1590d477549f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:23 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Volume 8a88af5b-3b8c-4cde-901c-49d428d84eff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a88af5b-3b8c-4cde-901c-49d428d84eff', 'volume_size': 1} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-818057715',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a88af5b-3b8c-4cde-901c-49d428d84eff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='71081bec6bc543e9807ce59a3a29a409',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:23Z,use_quota=True,user_id='ee185c05db0f448380544934b0beb617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Creating volume 8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:23 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-0c30a582-5e51-4fa4-adba-bdc9cc0499b4-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:23 devstack sudo[107909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff 1073741824 Nov 05 11:15:23 devstack sudo[107909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-0c30a582-5e51-4fa4-adba-bdc9cc0499b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-0c30a582-5e51-4fa4-adba-bdc9cc0499b4" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-0c30a582-5e51-4fa4-adba-bdc9cc0499b4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Deleting offline snapshot 0c30a582-5e51-4fa4-adba-bdc9cc0499b4 of volume 7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] snapshot_file for this snap is: volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[2296e44f-e458-4af4-a0b6-c6a5d1677c9c]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:23 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:23 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 Nov 05 11:15:23 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:24 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4" returned: 0 in 0.434s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:24 devstack sudo[107909]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff 1073741824" returned: 0 in 0.592s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[62f2f712-76bb-4fea-b33b-1eee16251e4a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:24 devstack sudo[107921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff Nov 05 11:15:24 devstack sudo[107921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:24 devstack sudo[107920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 Nov 05 11:15:24 devstack sudo[107920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:24 devstack sudo[107921]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff" returned: 0 in 0.267s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24f43937-3659-459f-8459-1590d477549f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a88af5b-3b8c-4cde-901c-49d428d84eff', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7405c91b-6e6f-415f-b4f1-83d97bd69035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:24 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Volume volume-8a88af5b-3b8c-4cde-901c-49d428d84eff (8a88af5b-3b8c-4cde-901c-49d428d84eff): created successfully Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7405c91b-6e6f-415f-b4f1-83d97bd69035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Flow 'volume_create_manager' (fda8be05-3558-4141-8ed6-aa040737d30b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:24 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d3305bbe-8cb0-46af-b19a-2e698adf8837 tempest-ProjectMemberTests-1322633992 None] Created volume successfully. Nov 05 11:15:24 devstack sudo[107920]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2" returned: 0 in 0.446s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:24 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 Nov 05 11:15:24 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:24 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4" returned: 0 in 0.373s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:24 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:24 devstack sudo[107934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4 Nov 05 11:15:24 devstack sudo[107934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:25 devstack sudo[107934]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2.0c30a582-5e51-4fa4-adba-bdc9cc0499b4" returned: 0 in 0.278s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-0c30a582-5e51-4fa4-adba-bdc9cc0499b4" released by "_delete_snapshot" :: held 1.674s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" released by "delete_snapshot" :: held 1.703s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Created reservations ['eea2352d-3857-4567-ac28-386da470bf02', 'c1314b4f-823d-4d2f-a27e-48d5ebf43b09', 'cfb46050-b4f4-4058-97bf-8a5426151aea', 'fafc8a12-2426-49fc-8ae0-025a4e3092d0'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:25 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Delete snapshot completed successfully. Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3f2190d8-1f8f-41c3-8ba8-02d13ae184d2 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-0c30a582-5e51-4fa4-adba-bdc9cc0499b4-delete_snapshot" released by "delete_snapshot" :: held 1.861s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-7edb14b0-316e-42d0-ba9a-e5b37231fed2-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Creating offline snapshot aa78ab64-d49a-439c-baac-680831a61592 of volume 8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-7edb14b0-316e-42d0-ba9a-e5b37231fed2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6c3466-b910-4629-b38e-fd4fe00fc101]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cb433f-a85d-4d75-9af5-914751bdc6c8]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:25 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:25 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff Nov 05 11:15:25 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:25 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 Nov 05 11:15:25 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:26 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff" returned: 0 in 0.352s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 1G {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:26 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 1G Nov 05 11:15:26 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:26 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2" returned: 0 in 0.387s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:26 devstack sudo[107949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2 Nov 05 11:15:26 devstack sudo[107949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:26 devstack sudo[107949]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-7edb14b0-316e-42d0-ba9a-e5b37231fed2" returned: 0 in 0.264s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-quobyte-7edb14b0-316e-42d0-ba9a-e5b37231fed2" released by "delete_volume" :: held 0.720s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:26 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 1G" returned: 0 in 0.439s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a88af5b-3b8c-4cde-901c-49d428d84eff -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:26 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a88af5b-3b8c-4cde-901c-49d428d84eff -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 Nov 05 11:15:26 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:26 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8a88af5b-3b8c-4cde-901c-49d428d84eff -F qcow2 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592" returned: 0 in 0.290s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:26 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 is being set with open permissions: ugo+rw Nov 05 11:15:26 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:26 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 Nov 05 11:15:26 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:26 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592" returned: 0 in 0.240s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:27 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Created reservations ['70973828-8ce0-49e4-95b5-32e5f4cc9a4d', '1801cdef-f551-49b1-9d5f-bfd0d7eed1da', '85fc477f-18bc-4ae8-987c-bde854fb6e24', '17f5c83f-40a3-47d1-9909-ef7c1f39e9d3'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:27 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info Nov 05 11:15:27 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:27 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:27 devstack cinder-volume[87369]: WARNING cinder.volume.drivers.remotefs [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info is being set with open permissions: ugo+rw Nov 05 11:15:27 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:27 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info Nov 05 11:15:27 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:28 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.info" returned: 0 in 0.230s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:28 devstack sudo[107971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:28 devstack sudo[107971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:28 devstack sudo[107971]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.225s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:28 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Deleted volume successfully. Nov 05 11:15:28 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-89438c29-04db-4078-8f2f-4ab15e02f356 tempest-ProjectMemberTests-1322633992 None] Create snapshot completed successfully Nov 05 11:15:29 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-31a6f61e-f591-41c2-bc1e-839386817826 tempest-ProjectReaderTests-1253151684 None] Lock "cinder-7edb14b0-316e-42d0-ba9a-e5b37231fed2-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:31 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-aa78ab64-d49a-439c-baac-680831a61592-delete_snapshot" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-aa78ab64-d49a-439c-baac-680831a61592-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" by "delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-aa78ab64-d49a-439c-baac-680831a61592" by "_delete_snapshot" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-aa78ab64-d49a-439c-baac-680831a61592" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Deleting offline snapshot aa78ab64-d49a-439c-baac-680831a61592 of volume 8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] snapshot_file for this snap is: volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[909497d4-3b9e-4c3f-a6da-5605fb6ce291]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:32 devstack sudo[108009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 Nov 05 11:15:32 devstack sudo[108009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:32 devstack sudo[108009]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592" returned: 0 in 0.414s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8a88af5b-3b8c-4cde-901c-49d428d84eff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87369) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bcf0e3d-5da3-408e-92fe-d85b45be17b0]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:32 devstack sudo[108016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff Nov 05 11:15:32 devstack sudo[108016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:32 devstack sudo[108016]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff" returned: 0 in 0.373s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:32 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:32 devstack sudo[108021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 Nov 05 11:15:32 devstack sudo[108021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:33 devstack sudo[108021]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592" returned: 0 in 0.410s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:33 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592 Nov 05 11:15:33 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:33 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff.aa78ab64-d49a-439c-baac-680831a61592" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-aa78ab64-d49a-439c-baac-680831a61592" released by "_delete_snapshot" :: held 1.610s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" released by "delete_snapshot" :: held 1.644s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Created reservations ['75a734c6-e3ee-4fed-b73d-b3f40004d003', 'fa8e6914-fdd4-4b1d-8bd7-b4dc5f69ae6a', '74be800f-860b-4004-8a09-2909bf8b8322', '94c64a3f-304b-4885-a024-bc8e24966ea9'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:33 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Delete snapshot completed successfully. Nov 05 11:15:33 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-94fb5e16-c91a-4921-9971-5dca9f32ba07 tempest-ProjectMemberTests-1322633992 None] Lock "cinder-aa78ab64-d49a-439c-baac-680831a61592-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-8a88af5b-3b8c-4cde-901c-49d428d84eff-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "cinder-8a88af5b-3b8c-4cde-901c-49d428d84eff-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Acquiring lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" acquired by "delete_volume" :: waited 0.018s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0600168-11c5-44c1-a87c-feec09971e48]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:34 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff Nov 05 11:15:34 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:34 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff" returned: 0 in 0.382s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:34 devstack sudo[108036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff Nov 05 11:15:34 devstack sudo[108036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:34 devstack sudo[108036]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:34 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8a88af5b-3b8c-4cde-901c-49d428d84eff" returned: 0 in 0.256s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "cinder-quobyte-8a88af5b-3b8c-4cde-901c-49d428d84eff" released by "delete_volume" :: held 0.728s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Created reservations ['40763c12-039b-45b3-8c78-a5f45d0841b8', 'fcf3629a-0c55-4cdc-9d71-5ac3cd1ab37c', '72850087-6511-4a14-b297-aafb930ab13b', '710759be-664f-401e-997f-1ecb1fa22aca'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:35 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:35 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:35 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.270s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:35 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Deleted volume successfully. Nov 05 11:15:35 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-3de9f8eb-1dd7-4e4e-b933-f85e3862d72a tempest-ProjectMemberTests-1322633992 None] Lock "cinder-8a88af5b-3b8c-4cde-901c-49d428d84eff-delete_volume" released by "delete_volume" :: held 1.250s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Flow 'volume_create_manager' (a0be1106-1a2b-46a9-9334-f32d302acba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5ae35-62ab-4625-9442-52a0bbde31d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (21b5ae35-62ab-4625-9442-52a0bbde31d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824781535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8578c486-e481-4b97-abf5-e91d3be7f7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfbf431da7a490ca9a14f26fe185983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:44Z,use_quota=True,user_id='04542de61eb34a19b75c27f87848897f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8520ce-e3ce-4a4f-8d3b-25fd12bfa920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc8520ce-e3ce-4a4f-8d3b-25fd12bfa920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5947c96-0951-4ad8-8d49-a22967bef5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5947c96-0951-4ad8-8d49-a22967bef5ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8578c486-e481-4b97-abf5-e91d3be7f7bd', 'volume_name': 'volume-8578c486-e481-4b97-abf5-e91d3be7f7bd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64cfed6-feb0-41b5-a17b-1dc2df86b7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b64cfed6-feb0-41b5-a17b-1dc2df86b7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5430a9-a1cf-4437-8d5c-7d6e5f8d5e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:44 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Volume 8578c486-e481-4b97-abf5-e91d3be7f7bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8578c486-e481-4b97-abf5-e91d3be7f7bd', 'volume_size': 1} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824781535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8578c486-e481-4b97-abf5-e91d3be7f7bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfbf431da7a490ca9a14f26fe185983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:44Z,use_quota=True,user_id='04542de61eb34a19b75c27f87848897f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Creating volume 8578c486-e481-4b97-abf5-e91d3be7f7bd {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:44 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:44 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:44 devstack sudo[108044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd 1073741824 Nov 05 11:15:44 devstack sudo[108044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:45 devstack sudo[108044]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd 1073741824" returned: 0 in 0.492s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:45 devstack sudo[108050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd Nov 05 11:15:45 devstack sudo[108050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:45 devstack sudo[108050]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd" returned: 0 in 0.296s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] <== create_volume: return (852ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.856s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c5430a9-a1cf-4437-8d5c-7d6e5f8d5e68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8578c486-e481-4b97-abf5-e91d3be7f7bd', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96e947a-0107-4a55-946b-778502470cff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:45 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Volume volume-8578c486-e481-4b97-abf5-e91d3be7f7bd (8578c486-e481-4b97-abf5-e91d3be7f7bd): created successfully Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a96e947a-0107-4a55-946b-778502470cff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:45 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Flow 'volume_create_manager' (a0be1106-1a2b-46a9-9334-f32d302acba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:45 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-2e00c16a-5319-4fb0-8e67-cc195c1f627f tempest-ProjectReaderTests-1554800384 None] Created volume successfully. Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Acquiring lock "cinder-8578c486-e481-4b97-abf5-e91d3be7f7bd-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "cinder-8578c486-e481-4b97-abf5-e91d3be7f7bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Acquiring lock "cinder-quobyte-8578c486-e481-4b97-abf5-e91d3be7f7bd" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "cinder-quobyte-8578c486-e481-4b97-abf5-e91d3be7f7bd" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba68b4fd-8211-4c96-9820-734af586a70b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:46 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:47 devstack sudo[108054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd Nov 05 11:15:47 devstack sudo[108054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:47 devstack sudo[108054]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd" returned: 0 in 0.395s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:47 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd Nov 05 11:15:47 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:47 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8578c486-e481-4b97-abf5-e91d3be7f7bd" returned: 0 in 0.271s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "cinder-quobyte-8578c486-e481-4b97-abf5-e91d3be7f7bd" released by "delete_volume" :: held 0.708s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Created reservations ['2d4b1fee-45dc-43ec-ba77-a5d2f800bf7b', '64f459c4-ee81-4303-a8cb-537f7ba5105d', '4455da7c-4d1d-4ea3-aed9-ea435083ed51', '9ae09458-2718-4785-9d4b-6f50d5acb930'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:47 devstack sudo[108062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:47 devstack sudo[108062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:47 devstack sudo[108062]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.251s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:47 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Deleted volume successfully. Nov 05 11:15:47 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-58acffe6-3cf2-42c2-b502-38bf7687d38c tempest-ProjectReaderTests-1554800384 None] Lock "cinder-8578c486-e481-4b97-abf5-e91d3be7f7bd-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Flow 'volume_create_manager' (860d737f-c786-43cb-b3ce-7a0fec87ca50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae04a22-6a53-44fa-a162-72c9ff621cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dae04a22-6a53-44fa-a162-72c9ff621cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606821082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af2f92d-885a-4dbd-962f-bf7ca2a7603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfbf431da7a490ca9a14f26fe185983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:48Z,use_quota=True,user_id='04542de61eb34a19b75c27f87848897f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0366d-0c4e-45fb-a81d-27f759f612a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26c0366d-0c4e-45fb-a81d-27f759f612a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36de3756-e72e-4cb3-ab19-f6828d459152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36de3756-e72e-4cb3-ab19-f6828d459152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4af2f92d-885a-4dbd-962f-bf7ca2a7603c', 'volume_name': 'volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b04d1d8-ccb1-4b18-9a47-fa8abd27a9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b04d1d8-ccb1-4b18-9a47-fa8abd27a9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a8ec4-d995-4c6a-8d0d-8bace45dd850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Volume 4af2f92d-885a-4dbd-962f-bf7ca2a7603c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c', 'volume_size': 1} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-606821082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4af2f92d-885a-4dbd-962f-bf7ca2a7603c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4dfbf431da7a490ca9a14f26fe185983',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:48Z,use_quota=True,user_id='04542de61eb34a19b75c27f87848897f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Creating volume 4af2f92d-885a-4dbd-962f-bf7ca2a7603c {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:48 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:48 devstack sudo[108068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c 1073741824 Nov 05 11:15:48 devstack sudo[108068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (74471e7f-d0d6-436f-ad67-c060df0c2b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbf92e3-b636-4246-9e39-1618b9bce5e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bbf92e3-b636-4246-9e39-1618b9bce5e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017215125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905b433e-bf10-430c-9084-c201e7cd68d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:49Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b05750-7f6e-4da8-aa28-02f91cfdebde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77b05750-7f6e-4da8-aa28-02f91cfdebde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d3c093-0cca-4a0b-a251-2071d5170884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6d3c093-0cca-4a0b-a251-2071d5170884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '905b433e-bf10-430c-9084-c201e7cd68d1', 'volume_name': 'volume-905b433e-bf10-430c-9084-c201e7cd68d1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20acfe69-fce2-4a34-87ec-9740346ed7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20acfe69-fce2-4a34-87ec-9740346ed7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589d546b-4083-4ecd-b662-ac8283eb8ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:48 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Volume 905b433e-bf10-430c-9084-c201e7cd68d1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-905b433e-bf10-430c-9084-c201e7cd68d1', 'volume_size': 1} Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:48 devstack sudo[108068]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:48 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c 1073741824" returned: 0 in 0.437s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:49 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c Nov 05 11:15:49 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:49 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" returned: 0 in 0.254s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.746s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.523s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2017215125',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=905b433e-bf10-430c-9084-c201e7cd68d1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:49Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Creating volume 905b433e-bf10-430c-9084-c201e7cd68d1 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:49 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c0a8ec4-d995-4c6a-8d0d-8bace45dd850) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:49 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 1073741824 Nov 05 11:15:49 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86999569-1367-4653-8059-6afc6d4844c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:49 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Volume volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c (4af2f92d-885a-4dbd-962f-bf7ca2a7603c): created successfully Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86999569-1367-4653-8059-6afc6d4844c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Flow 'volume_create_manager' (860d737f-c786-43cb-b3ce-7a0fec87ca50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:49 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d5ca3a86-7593-484e-8102-6dac367e9784 tempest-ProjectReaderTests-1554800384 None] Created volume successfully. Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Acquiring lock "cinder-4af2f92d-885a-4dbd-962f-bf7ca2a7603c-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "cinder-4af2f92d-885a-4dbd-962f-bf7ca2a7603c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Acquiring lock "cinder-quobyte-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "cinder-quobyte-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" acquired by "delete_volume" :: waited 0.023s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0efe07a6-680f-4fa0-a567-69d842a03244]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:49 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c Nov 05 11:15:49 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:49 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 1073741824" returned: 0 in 0.531s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:49 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:49 devstack sudo[108084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 Nov 05 11:15:49 devstack sudo[108084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:50 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" returned: 0 in 0.437s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:50 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c Nov 05 11:15:50 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:50 devstack sudo[108084]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1" returned: 0 in 0.312s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (589d546b-4083-4ecd-b662-ac8283eb8ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-905b433e-bf10-430c-9084-c201e7cd68d1', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a49c521-eef9-4229-8885-36378378c313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:50 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Volume volume-905b433e-bf10-430c-9084-c201e7cd68d1 (905b433e-bf10-430c-9084-c201e7cd68d1): created successfully Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a49c521-eef9-4229-8885-36378378c313) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (74471e7f-d0d6-436f-ad67-c060df0c2b59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-1cd7329b-dc14-47a7-a1a2-9de342abb2a3 tempest-ProjectReaderTests-554099675 None] Created volume successfully. Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:50 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:50 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:50 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" returned: 0 in 0.271s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "cinder-quobyte-4af2f92d-885a-4dbd-962f-bf7ca2a7603c" released by "delete_volume" :: held 0.752s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Created reservations ['47fbe8c7-a91d-45fc-99a3-bf5860751f3e', '7feb2615-8c29-4bcd-8d87-036296559d61', 'bc4e93ed-46b4-4405-b0f0-f975e60d5aee', 'd5adc38b-f094-4cbe-82ba-52ea24951f19'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:50 devstack sudo[108096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:50 devstack sudo[108096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:50 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.286s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_service.periodic_task [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] Running periodic task VolumeManager._thread_info {{(pid=87369) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread count: 29 {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5471}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-ca90b05a-b637-4229-81ad-d9c0a879e1a0 None None] thread info: [<_MainThread(MainThread, started 124275690856576)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87369) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 05 11:15:50 devstack sudo[108096]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.303s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:50 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Deleted volume successfully. Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c3d22451-1498-488c-a7f5-22d4ee275411 tempest-ProjectReaderTests-1554800384 None] Lock "cinder-4af2f92d-885a-4dbd-962f-bf7ca2a7603c-delete_volume" released by "delete_volume" :: held 1.283s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-905b433e-bf10-430c-9084-c201e7cd68d1-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:50 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "cinder-905b433e-bf10-430c-9084-c201e7cd68d1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-quobyte-905b433e-bf10-430c-9084-c201e7cd68d1" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-905b433e-bf10-430c-9084-c201e7cd68d1" acquired by "delete_volume" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d7ee7b-0fb5-4a32-8bfe-7d76b526e56a]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:51 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 Nov 05 11:15:51 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:51 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1" returned: 0 in 0.393s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:51 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1 Nov 05 11:15:51 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:51 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-905b433e-bf10-430c-9084-c201e7cd68d1" returned: 0 in 0.268s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-905b433e-bf10-430c-9084-c201e7cd68d1" released by "delete_volume" :: held 0.712s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Created reservations ['a9b42ee4-ae49-49bc-95ca-4ac4f141656d', '6395dd94-1c12-4638-8886-fc68928b1a36', 'e0d92138-c076-4557-8014-92d3f7ffd7eb', '5981df03-c19c-4ee7-a2a7-a6b3d6380216'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:51 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:51 devstack sudo[108108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:51 devstack sudo[108108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:52 devstack sudo[108108]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.272s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:52 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Deleted volume successfully. Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-c859a634-30fe-499d-8c59-dc9ef6c1933b tempest-ProjectReaderTests-554099675 None] Lock "cinder-905b433e-bf10-430c-9084-c201e7cd68d1-delete_volume" released by "delete_volume" :: held 1.232s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (187d0dbd-b981-4d9a-bd26-5af401947950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83c650b-d6f7-44df-8ffd-7f2802b308ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a83c650b-d6f7-44df-8ffd-7f2802b308ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97109616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ce389-3676-431d-bcf3-632f12715d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:53Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca81dab-679d-478a-b6d9-c0b9a2388bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ca81dab-679d-478a-b6d9-c0b9a2388bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cb5753-b75e-4931-9d7e-bd42d32fc54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00cb5753-b75e-4931-9d7e-bd42d32fc54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a1ce389-3676-431d-bcf3-632f12715d6a', 'volume_name': 'volume-9a1ce389-3676-431d-bcf3-632f12715d6a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7ba935-4604-4d53-9d94-4b7767694ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc7ba935-4604-4d53-9d94-4b7767694ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce91bab4-5bf0-433b-93de-7723bd709c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:52 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Volume 9a1ce389-3676-431d-bcf3-632f12715d6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a1ce389-3676-431d-bcf3-632f12715d6a', 'volume_size': 1} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97109616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a1ce389-3676-431d-bcf3-632f12715d6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:53Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Creating volume 9a1ce389-3676-431d-bcf3-632f12715d6a {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:52 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:52 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:52 devstack sudo[108111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a 1073741824 Nov 05 11:15:52 devstack sudo[108111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:53 devstack sudo[108111]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a 1073741824" returned: 0 in 0.436s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:53 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a Nov 05 11:15:53 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:53 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a" returned: 0 in 0.237s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] <== create_volume: return (716ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.718s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce91bab4-5bf0-433b-93de-7723bd709c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a1ce389-3676-431d-bcf3-632f12715d6a', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234628a0-e7f2-4041-a039-d2c1af5a9ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:53 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Volume volume-9a1ce389-3676-431d-bcf3-632f12715d6a (9a1ce389-3676-431d-bcf3-632f12715d6a): created successfully Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (234628a0-e7f2-4041-a039-d2c1af5a9ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (187d0dbd-b981-4d9a-bd26-5af401947950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:53 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-58aaf0ef-4e5f-4057-8275-955e17f4d41b tempest-ProjectReaderTests-554099675 None] Created volume successfully. Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-9a1ce389-3676-431d-bcf3-632f12715d6a-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "cinder-9a1ce389-3676-431d-bcf3-632f12715d6a-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-quobyte-9a1ce389-3676-431d-bcf3-632f12715d6a" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-9a1ce389-3676-431d-bcf3-632f12715d6a" acquired by "delete_volume" :: waited 0.015s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[0070f2e3-13ba-4afc-87dd-e3fcae238fcf]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:53 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:53 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a Nov 05 11:15:53 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:54 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a" returned: 0 in 0.370s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:54 devstack sudo[108125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a Nov 05 11:15:54 devstack sudo[108125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:54 devstack sudo[108125]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-9a1ce389-3676-431d-bcf3-632f12715d6a" returned: 0 in 0.242s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-9a1ce389-3676-431d-bcf3-632f12715d6a" released by "delete_volume" :: held 0.651s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Created reservations ['8b320a31-05a8-4100-b7d7-de379122a0bb', 'a12ac521-0581-432d-b95d-df21b0e1e770', 'a2ec4b88-d8e4-4158-9f57-75ff2a1a4c7f', '64cb06d7-780e-4e54-a54a-ed82c9cba242'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:54 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:54 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:54 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.281s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:54 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Deleted volume successfully. Nov 05 11:15:54 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-b216f240-60e9-4eb2-afff-6d9171469cc5 tempest-ProjectReaderTests-554099675 None] Lock "cinder-9a1ce389-3676-431d-bcf3-632f12715d6a-delete_volume" released by "delete_volume" :: held 1.124s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (510f3aff-84cc-43b1-9e89-b8054b629e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68a28e4-591e-4d6e-b2a9-01435ee23a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f68a28e4-591e-4d6e-b2a9-01435ee23a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698501538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f831d5d0-9f01-4127-a62b-d36e4a8e8db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:55Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdbac2e-fdc4-4d4e-a82e-817b5ff3c274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ecdbac2e-fdc4-4d4e-a82e-817b5ff3c274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc1a53c-62f7-4450-b66a-ff6745e8eae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4bc1a53c-62f7-4450-b66a-ff6745e8eae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f831d5d0-9f01-4127-a62b-d36e4a8e8db0', 'volume_name': 'volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86afcd97-fe39-4dfb-80bd-738d49712ef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86afcd97-fe39-4dfb-80bd-738d49712ef7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89465fde-8c0a-4866-a933-7cd28772bde4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:55 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Volume f831d5d0-9f01-4127-a62b-d36e4a8e8db0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0', 'volume_size': 1} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-698501538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f831d5d0-9f01-4127-a62b-d36e4a8e8db0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:55Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Creating volume f831d5d0-9f01-4127-a62b-d36e4a8e8db0 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:55 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:55 devstack sudo[108131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 1073741824 Nov 05 11:15:55 devstack sudo[108131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:55 devstack sudo[108131]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 1073741824" returned: 0 in 0.419s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:55 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:55 devstack sudo[108136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 Nov 05 11:15:55 devstack sudo[108136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:56 devstack sudo[108136]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" returned: 0 in 0.239s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] <== create_volume: return (697ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.700s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89465fde-8c0a-4866-a933-7cd28772bde4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90159767-602d-4597-98b0-ad6b1cc63314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:56 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Volume volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 (f831d5d0-9f01-4127-a62b-d36e4a8e8db0): created successfully Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90159767-602d-4597-98b0-ad6b1cc63314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (510f3aff-84cc-43b1-9e89-b8054b629e64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:56 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-29f78944-9a5e-420d-85eb-0edef7a1c6d6 tempest-ProjectReaderTests-554099675 None] Created volume successfully. Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-f831d5d0-9f01-4127-a62b-d36e4a8e8db0-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "cinder-f831d5d0-9f01-4127-a62b-d36e4a8e8db0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-quobyte-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" acquired by "delete_volume" :: waited 0.014s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e12ef60-95a4-49ad-a2bf-5b9e776e37c7]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:56 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 Nov 05 11:15:56 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:56 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" returned: 0 in 0.368s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:56 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:56 devstack sudo[108144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0 Nov 05 11:15:56 devstack sudo[108144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:57 devstack sudo[108144]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" returned: 0 in 0.274s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-f831d5d0-9f01-4127-a62b-d36e4a8e8db0" released by "delete_volume" :: held 0.682s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Created reservations ['83fac83c-a144-4170-b686-6c2f5bece217', '4f38baf8-739e-4aad-ad1a-f0bc009e63c4', 'd1fb4565-b2d1-4964-bb39-6d828dffb51c', '88aece4f-f706-4128-ab48-6eafc156930a'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:57 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:57 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:57 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.266s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:15:57 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Deleted volume successfully. Nov 05 11:15:57 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-f5f87496-2c82-47b8-b919-e80b143a77d7 tempest-ProjectReaderTests-554099675 None] Lock "cinder-f831d5d0-9f01-4127-a62b-d36e4a8e8db0-delete_volume" released by "delete_volume" :: held 1.160s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87369) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (35bb188d-970d-4310-8e99-4cb527690cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b9136-1bb0-4ea4-9804-a2ce60eefe61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (811b9136-1bb0-4ea4-9804-a2ce60eefe61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394850809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8476f1b3-b0e2-42c1-a5f4-0a08326d1d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:58Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cb342d-d61e-424b-9fd1-92200ab926e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0cb342d-d61e-424b-9fd1-92200ab926e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245b5a3f-d69e-406b-85ad-d1c35b970199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (245b5a3f-d69e-406b-85ad-d1c35b970199) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8476f1b3-b0e2-42c1-a5f4-0a08326d1d32', 'volume_name': 'volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad3ebf6-2254-4ca8-84b7-9db48cb678c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bad3ebf6-2254-4ca8-84b7-9db48cb678c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902848d0-6605-4402-941c-c6116c8a5c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Volume 8476f1b3-b0e2-42c1-a5f4-0a08326d1d32: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32', 'volume_size': 1} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-05T10:15:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-394850809',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8476f1b3-b0e2-42c1-a5f4-0a08326d1d32,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='74ba55f3e2e04cc8acdf53584dde065e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-05T10:15:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-05T10:15:58Z,use_quota=True,user_id='5c320a2a49464038a4997105afca7b7f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc),volume_type_id=ce9d48ab-c9d5-43bf-b4c0-093aaa8788cc)}" {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.remotefs [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Creating volume 8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 {{(pid=87369) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Selected osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb as target Quobyte volume. {{(pid=87369) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 05 11:15:58 devstack cinder-volume[87369]: INFO cinder.volume.drivers.remotefs [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] casted to osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 1073741824 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:58 devstack sudo[108150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 1073741824 Nov 05 11:15:58 devstack sudo[108150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:58 devstack sudo[108150]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 1073741824" returned: 0 in 0.420s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:58 devstack sudo[108157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 Nov 05 11:15:58 devstack sudo[108157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:58 devstack sudo[108157]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" returned: 0 in 0.273s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] <== create_volume: return (741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'} {{(pid=87369) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (902848d0-6605-4402-941c-c6116c8a5c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32', 'volume_size': 1}' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c80e528-fd06-4107-bf00-c57c05d7630c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 05 11:15:58 devstack cinder-volume[87369]: INFO cinder.volume.flows.manager.create_volume [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Volume volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 (8476f1b3-b0e2-42c1-a5f4-0a08326d1d32): created successfully Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c80e528-fd06-4107-bf00-c57c05d7630c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87369) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 05 11:15:58 devstack cinder-volume[87369]: DEBUG cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Flow 'volume_create_manager' (35bb188d-970d-4310-8e99-4cb527690cac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87369) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 05 11:15:58 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-d9b75a2c-941d-4f6c-bcc0-1bf857a109bb tempest-ProjectReaderTests-554099675 None] Created volume successfully. Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32-delete_volume" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "cinder-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Acquiring lock "cinder-quobyte-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" by "delete_volume" {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" acquired by "delete_volume" :: waited 0.016s {{(pid=87369) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb6a8c6-6712-498f-919b-f2111695896b]: (4, 'qcow2') {{(pid=88447) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:59 devstack sudo[108160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 Nov 05 11:15:59 devstack sudo[108160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:59 devstack sudo[108160]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" returned: 0 in 0.367s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:59 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32 Nov 05 11:15:59 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:15:59 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14/volume-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" returned: 0 in 0.275s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "cinder-quobyte-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32" released by "delete_volume" :: held 0.682s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.quota [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Created reservations ['5eee64c4-db30-4232-b351-4c58e67e653f', 'ad0fe066-69c5-404a-837d-c2ad93e219f0', 'b0d06d3a-f86e-46d0-9374-117dd6c6609d', '5d107909-bd89-4a2d-abd5-18cd1a98f8d1'] {{(pid=87369) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb': None} {{(pid=87369) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG cinder.volume.drivers.quobyte [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-3db35db4-551a-4208-b7bf-d4af4b6af6eb'] {{(pid=87369) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.lockutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87369) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 05 11:15:59 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 05 11:15:59 devstack sudo[108168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14 Nov 05 11:15:59 devstack sudo[108168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 05 11:16:00 devstack sudo[108168]: pam_unix(sudo:session): session closed for user root Nov 05 11:16:00 devstack cinder-volume[87369]: DEBUG oslo_concurrency.processutils [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/d4681c9c84239c53af8c42158b850f14" returned: 0 in 0.263s {{(pid=87369) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 05 11:16:00 devstack cinder-volume[87369]: DEBUG cinder.manager [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Notifying Schedulers of capabilities ... {{(pid=87369) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 05 11:16:00 devstack cinder-volume[87369]: INFO cinder.volume.manager [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Deleted volume successfully. Nov 05 11:16:00 devstack cinder-volume[87369]: DEBUG cinder.coordination [None req-ed63c59f-7df0-43d3-a689-e0016ebf0476 tempest-ProjectReaderTests-554099675 None] Lock "cinder-8476f1b3-b0e2-42c1-a5f4-0a08326d1d32-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=87369) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 05 11:16:09 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:SELECT=88,cinder:INSERT=33,cinder:UPDATE=137,cinder:DELETE=14 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 05 11:16:10 devstack cinder-volume[87369]: DEBUG dbcounter [-] [87369] Writing DB stats cinder:UPDATE=125,cinder:SELECT=95,cinder:INSERT=34,cinder:DELETE=7 {{(pid=87369) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}